-- Logs begin at Sun 2022-09-25 00:10:46 UTC, end at Sun 2022-09-25 01:08:05 UTC. -- Sep 25 00:40:21.638247 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 25 00:40:21.645604 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 25 00:40:21.647609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 25 00:40:21 2022] *** Sep 25 00:40:21.647609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 25 00:40:21.647609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 25 00:40:21.647609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: nodename: dv-osbrick-master-4-iscsi Sep 25 00:40:21.647609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: machine: x86_64 Sep 25 00:40:21.647609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: clock source: unix Sep 25 00:40:21.647609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: pcre jit disabled Sep 25 00:40:21.648058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: detected number of CPU cores: 4 Sep 25 00:40:21.648058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: current working directory: / Sep 25 00:40:21.648058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: detected binary path: /usr/bin/uwsgi-core Sep 25 00:40:21.648058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: your processes number limit is 47680 Sep 25 00:40:21.648058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: your memory page size is 4096 bytes Sep 25 00:40:21.648058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: detected max file descriptor number: 2048 Sep 25 00:40:21.648058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: lock engine: pthread robust mutexes Sep 25 00:40:21.648058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: thunder lock: enabled Sep 25 00:40:21.648058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 25 00:40:21.648058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 25 00:40:21.688816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: Python main interpreter initialized at 0x556b5ede69c0 Sep 25 00:40:21.688816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: python threads support enabled Sep 25 00:40:21.688816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: your server socket listen backlog is limited to 100 connections Sep 25 00:40:21.688816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: your mercy for graceful operations on workers is 90 seconds Sep 25 00:40:21.689184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: mapped 403077 bytes (393 KB) for 2 cores Sep 25 00:40:21.689273 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: *** Operational MODE: preforking *** Sep 25 00:40:21.689539 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: *** uWSGI is running in multiple interpreter mode *** Sep 25 00:40:21.689539 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: spawned uWSGI master process (pid: 81358) Sep 25 00:40:21.689739 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 25 00:40:21.696577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: spawned uWSGI worker 1 (pid: 81370, cores: 1) Sep 25 00:40:21.696577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: spawned uWSGI worker 2 (pid: 81371, cores: 1) Sep 25 00:40:21.696577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 25 00:40:25.978584 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:40:25.978584 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: from cryptography.utils import int_from_bytes Sep 25 00:40:25.979357 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:40:25.979357 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: from cryptography.utils import int_from_bytes Sep 25 00:40:25.979357 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:40:25.979357 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: from cryptography.utils import int_from_bytes Sep 25 00:40:25.979866 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:40:25.979866 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: from cryptography.utils import int_from_bytes Sep 25 00:40:26.029291 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 00:40:26.029436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 00:40:26.029535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 00:40:26.029625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 00:40:26.029699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] command line args: [] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 00:40:26.029769 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] command line args: [] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 00:40:26.029924 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 00:40:26.030017 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 00:40:26.030096 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ================================================================================ {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 00:40:26.030174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ================================================================================ {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 00:40:26.030347 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] admin_token = **** {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.030428 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] admin_token = **** {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.030594 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] config_dir = [] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.030673 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] config_dir = [] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.030782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.030866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.030965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] config_source = [] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.031049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] config_source = [] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.031131 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] debug = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.031204 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] debug = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.031346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.032112 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.032276 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.032353 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.032419 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.032478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.032685 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.032804 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.032940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.033045 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.033171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] list_limit = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.033287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] list_limit = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.033391 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] log_config_append = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.033485 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] log_config_append = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.033591 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.033687 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.033687 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] log_dir = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.033877 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] log_dir = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.033971 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] log_file = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.034064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] log_file = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.034064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.034284 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.034405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.034481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.034602 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.034678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.034804 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.034883 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.035000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.035082 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.035156 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.035285 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.035362 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.035478 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.035559 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.035632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.035791 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.035884 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.036022 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.036107 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.036255 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.036339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.036487 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.036622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.036762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.036850 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.037010 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.037094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.037286 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.037376 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.037775 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.037923 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.038039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] publish_errors = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.038145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] publish_errors = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.038285 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.038392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.038558 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.038676 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.038818 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.039008 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.039135 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.039222 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.039328 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.039409 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] standard_threads = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.039481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] standard_threads = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.039550 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.039626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.039732 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.039805 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.039881 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.039958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] use_journal = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.040150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] use_journal = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.040224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] use_json = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.040300 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] use_json = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.040407 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] use_stderr = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.040487 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] use_stderr = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.040612 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] use_syslog = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.040705 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] use_syslog = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.040779 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.040856 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:40:26.040983 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.041062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.041225 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.041316 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.041488 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.041571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.041749 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.041832 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.041976 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.042062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.042215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.042298 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.042464 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.042541 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.042705 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.042790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.042956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.043041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.043204 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.043452 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.043538 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.043688 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.043766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.043933 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.044025 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.044168 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.044258 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.044414 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.044531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.044687 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.044775 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.044928 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.045017 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.045183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.045260 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.045438 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.045517 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.045668 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.045742 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.045911 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.045990 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.046161 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.046245 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.046427 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.046505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.046678 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.046755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.046927 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.047010 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.047202 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.047280 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.047434 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.047512 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.047666 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.047744 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.047901 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.047985 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.048148 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.048225 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.048394 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.048470 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.048649 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.048731 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.048879 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.048962 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.049127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.049204 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.049373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.049451 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.049613 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.049690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.049859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.049941 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.050092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.050176 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.050324 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.050403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.050558 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.050640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.050784 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.050863 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.051014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.051093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.051241 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.051318 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.051465 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.051538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.051695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.051786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.051944 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.052033 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.052176 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.052260 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.052414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.052492 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.052671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.052750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.053051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.053185 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.053291 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.053388 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.053481 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.053682 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.053779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.053880 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.053997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.054111 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.054214 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.054333 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.054453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.054563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.054713 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.054827 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.054949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.055065 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.055179 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.055412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.055527 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.055649 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.055754 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.055866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.055986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.056100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.056224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.056348 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.056464 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.056624 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.056744 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.056962 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.057082 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.057198 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.057322 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.057437 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.057550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.057663 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.057782 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.057897 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.058018 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.058141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.058264 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.058386 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.058501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.058652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.058779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.058894 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.059008 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.059120 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.059233 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.059353 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.059477 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.059592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.059706 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.059825 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.059946 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.060061 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.060182 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.060300 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.060413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.060525 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.060689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.060815 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.060939 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.061055 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.061168 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.061282 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.061395 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.061508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.061628 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.061744 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.061857 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.061970 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.062082 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.062194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.062317 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.062437 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.062550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.062664 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.062776 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.062895 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.063081 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.063199 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.063312 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.063426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.063540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.063661 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.063784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.063908 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.064023 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.064143 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.064258 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.064371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.064485 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.064641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.064760 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.064880 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.064996 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.065109 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.065222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.065344 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.065460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.065575 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.065800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.065913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.066035 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.066150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.066273 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.066396 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.066513 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.066657 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.066783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] auth.external = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.066900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] auth.external = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.067022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.067138 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.067252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.067376 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.067493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.067609 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.067732 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] auth.password = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.067848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] auth.password = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.067962 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] auth.token = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] auth.token = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.068189 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.068304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.068426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.068542 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.068719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.068835 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.068949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.069062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.069188 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.069306 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.069420 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.069534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.069649 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.069762 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.069884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] credential.caching = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.070000 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] credential.caching = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.070113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.070227 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.070340 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.070454 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.070577 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.070694 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.070808 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.070922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.071042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.071158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.071281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.071397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.071511 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.071624 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.071739 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.071852 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.072223 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.072347 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.072462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.072603 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.072721 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.072837 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.072964 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.073081 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.073195 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.073309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.073431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.073547 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.073669 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.073785 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.073900 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] federation.caching = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.074013 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] federation.caching = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.074126 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.074240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.074361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.074514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.074638 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.074754 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.074869 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.074991 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.075108 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.075222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.075336 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.075450 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.075570 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.075695 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.075811 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.075926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.076040 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.076154 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.076267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.076389 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.076505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.076671 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.076787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity.caching = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.076901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity.caching = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.077016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.077210 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.077329 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.077443 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.077557 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.077670 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.077785 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.077907 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.078025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.078025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.078719 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.078832 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.078947 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.078947 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.079173 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.079287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.079400 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.079400 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.079602 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.079724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.079840 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.079953 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.080066 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.080188 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.080304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.080426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.080543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.080690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.080804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.080931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.081048 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.081171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.081288 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.081288 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.081501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.081501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.081714 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.081835 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.081951 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.082064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.082177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.082291 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.082408 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.082530 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.082646 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.082760 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.082873 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.082986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.083099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.083221 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.083338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.083451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.083565 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.083678 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.083791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.083913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.084029 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.084142 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.084256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.084370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.084491 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.084664 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.084782 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.084896 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.085010 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.085124 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.085246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.085364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.085478 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.085591 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.085705 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.085818 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.085941 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.086057 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.086172 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.086286 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.086399 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.086513 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.086635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.086751 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.086865 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.086978 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.087123 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.087123 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.087349 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.087349 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.087572 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.087688 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.087801 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.087915 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.088037 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.088153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.088267 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.088416 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.088534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.088803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.088921 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.089036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.089151 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.089264 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.089378 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.089501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.089619 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.089733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.089846 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.089960 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.090075 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.090196 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.090313 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.090433 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.090549 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.090664 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.090778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.090900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.091016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.091130 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.091244 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.091357 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.091471 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.091592 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.091710 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.091824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.091938 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.092051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.092165 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.092286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.092405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.092519 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.092660 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.092776 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.092890 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.093017 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.093134 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.093249 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.093363 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.093476 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.093590 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.093712 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.093830 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.094569 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.094688 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.094804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.095051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.095169 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.095284 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.095398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.095512 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.095617 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.095738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.095856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.095970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.096084 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.096199 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.096313 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.096455 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.096598 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.096716 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.096831 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.096947 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.097071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.097197 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.097314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.097428 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.097542 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.097656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.097769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.097892 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.098010 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.098124 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.098238 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.098351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.098465 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] resource.caching = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.098588 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.098704 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.098818 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] resource.caching = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.098932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.099047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.099161 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.099288 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.099405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.099526 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.099642 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.099757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.099871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.099993 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.100110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.100224 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.100337 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.100450 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.100667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.100788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.100903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] role.caching = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.101017 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.101133 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] role.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.101246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] role.caching = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.101368 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.101484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] role.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.101599 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.101713 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.101827 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.101941 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.102064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.102181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.102296 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.102410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.102527 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.102642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.102764 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.102881 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.102995 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.103109 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.103223 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.103337 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.103459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.103575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.103689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.103810 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.103924 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.104043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.104166 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.104288 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.104404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.104518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.104676 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.104792 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.104919 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.105036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.105150 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.105264 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.105378 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.105492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.105615 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.105730 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.105844 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.105958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.106072 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.106194 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.106310 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.106425 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.106539 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.106653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.106767 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.106889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.107005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.107119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.107233 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.107347 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.107462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.107584 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.107701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.107815 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.107928 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.108042 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.108155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.108278 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.108394 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.108509 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.108639 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.108754 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.108878 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.109003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.109119 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] token.caching = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.109233 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.109347 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.109481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] token.caching = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.109601 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.109724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.109840 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.109954 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.110068 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.110181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.110294 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.110416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.110533 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.110533 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.110746 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.110858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.110971 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.111092 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.111208 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.111322 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.111435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.111548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.111662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.111784 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.111900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.112013 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.112126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.112126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.112337 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.112459 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.112603 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.112603 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.112845 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.112845 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.113073 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.113197 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.113313 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.connection = **** {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.113313 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.113534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.113650 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.113765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.connection = **** {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.113878 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.113992 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.114105 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.114231 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.114347 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.114461 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.114574 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.114687 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.114801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.114923 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.115039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.115152 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.115266 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.115379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.115492 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.115614 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.115730 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.115845 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.115959 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.116072 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.116186 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.116308 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.116424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.116543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.116731 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.116846 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.116959 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.117085 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.117201 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.117323 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.117438 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.117553 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.117666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 00:40:26.117789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.117789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:40:26.117789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 00:40:26.146130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.146363 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.146463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.146593 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.146679 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.146822 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.154994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.155214 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.183465 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.183703 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.184040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.184279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.237949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.238473 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.287148 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.287386 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.288054 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.288294 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.442255 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.442486 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.442573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.442713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.442795 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.442935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.443020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.443154 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.443246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.443372 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.443464 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.443624 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.467073 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.467309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.467399 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.467537 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.467635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.467763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.467847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.467987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.468069 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.468204 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.468288 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.468437 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.468520 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.468711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.479596 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.480051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.492029 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.492267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.492484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.492600 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.492728 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.492810 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.492945 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.493027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.493159 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.493250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.493374 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.493456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.493593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.493813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:40:26.510412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.510623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 25 00:40:26.510967 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.511048 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.511172 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 25 00:40:26.511253 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 25 00:40:26.511453 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.511560 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.511721 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.511803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 25 00:40:26.511983 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.512073 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.512244 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.512325 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.512523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.512820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.522362 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.522649 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.522929 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.523010 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.523220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.523302 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.523520 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.523812 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.530178 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.530814 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.533115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.533407 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.533698 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.533780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.533987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.534068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.534277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.534368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.534545 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.534628 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.534841 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.534945 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.535099 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.535190 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.535373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.535454 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.535651 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.535740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.535922 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.536003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.536200 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.536477 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.558491 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.559076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.559954 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.560244 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.560572 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.560862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.565458 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.565748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.566035 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.566116 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.566358 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.566651 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.572650 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.572942 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.573256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.573546 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.579030 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.579325 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.579613 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.579718 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.579902 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.580023 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.580185 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.580315 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.580463 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.580630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.580762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.580920 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.581037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.581207 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.581490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.581767 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.596472 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.596795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.597420 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.597914 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.600673 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.602909 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.603896 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.604195 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.606853 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.607155 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.608404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.611442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.611560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.614596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.614745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.615052 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.615342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.615630 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.615913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.616200 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.617794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.618101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.618394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.618685 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.618972 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.619263 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.632224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.632513 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.632807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.633076 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.635380 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.635675 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.635952 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.636223 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.639804 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.641933 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.643442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.643654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.643783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.645217 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.646433 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.646727 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.646807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.647012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.647095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.647293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.647688 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.649786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.650080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.650369 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.650662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.651080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.658845 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.659136 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.659423 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.659710 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.660099 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.660403 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.660710 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.662278 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.662567 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.662854 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.663145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.663534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.663833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.664119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.676513 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.679449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.679993 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.682343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.682962 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.683846 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.685344 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.685634 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.685900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.686036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.687368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.689426 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.689718 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.690125 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.692987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.694394 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.696469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.697563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.697965 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.698229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.698311 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.698535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.701157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.701566 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.701863 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.702149 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.706384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.706680 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.706967 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.710000 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.710299 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.710588 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.713864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.714155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.714457 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.714741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.715021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.715298 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.715575 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.715864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.716140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.716414 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.716731 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.717018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.717328 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.717495 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:40:26.717607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.717785 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.718074 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.718357 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.718635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.718941 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.719221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.719506 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.719782 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.720075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.720363 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.720657 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.720941 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.721217 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:40:26.752528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556b5ede69c0 pid: 81370 (default app) Sep 25 00:40:26.755894 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443340a-9ead-4262-8a17-98b340f6e094 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:26.756114 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556b5ede69c0 pid: 81371 (default app) Sep 25 00:40:26.756194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443340a-9ead-4262-8a17-98b340f6e094 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:26.756443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443340a-9ead-4262-8a17-98b340f6e094 None None] PATH_INFO: `/v3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:26.760565 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Sun Sep 25 00:40:26 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:33.522989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f61da4-df85-424b-8ac1-768657caa68d None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:33.523498 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f61da4-df85-424b-8ac1-768657caa68d None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:33.523602 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f61da4-df85-424b-8ac1-768657caa68d None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:33.527752 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:33.532880 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d590d82-2a5a-4a74-ba6b-6e0f298da3f0 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:33.533443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d590d82-2a5a-4a74-ba6b-6e0f298da3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:33.533443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d590d82-2a5a-4a74-ba6b-6e0f298da3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:33.610970 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: INFO dbcounter [None req-1d590d82-2a5a-4a74-ba6b-6e0f298da3f0 None None] Registered counter for database keystone Sep 25 00:40:33.629915 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG oslo_db.sqlalchemy.engines [None req-1d590d82-2a5a-4a74-ba6b-6e0f298da3f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:40:33.636081 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writer thread running {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:40:33.815579 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG passlib.handlers.bcrypt [None req-1d590d82-2a5a-4a74-ba6b-6e0f298da3f0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81370) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 25 00:40:33.815905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG passlib.handlers.bcrypt [None req-1d590d82-2a5a-4a74-ba6b-6e0f298da3f0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81370) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 25 00:40:33.874611 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-1d590d82-2a5a-4a74-ba6b-6e0f298da3f0 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:33.876806 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-1d590d82-2a5a-4a74-ba6b-6e0f298da3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:34.003425 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 25 00:40:34.494171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f61da4-df85-424b-8ac1-768657caa68d None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:34.564986 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: INFO dbcounter [None req-e9f61da4-df85-424b-8ac1-768657caa68d None None] Registered counter for database keystone Sep 25 00:40:34.586263 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG oslo_db.sqlalchemy.engines [None req-e9f61da4-df85-424b-8ac1-768657caa68d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:40:34.592464 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writer thread running {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:40:34.715859 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f61da4-df85-424b-8ac1-768657caa68d None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:34.720709 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f41a24-0983-4612-b14f-b616f069d223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:34.721335 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f41a24-0983-4612-b14f-b616f069d223 admin admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:34.721615 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f41a24-0983-4612-b14f-b616f069d223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:34.721887 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f41a24-0983-4612-b14f-b616f069d223 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:34.730008 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f41a24-0983-4612-b14f-b616f069d223 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:34.780605 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: WARNING keystone.common.rbac_enforcer.enforcer [None req-18f41a24-0983-4612-b14f-b616f069d223 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 25 00:40:34.780902 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f41a24-0983-4612-b14f-b616f069d223 admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:34.790570 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Sun Sep 25 00:40:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 00:40:34.796531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d590d82-2a5a-4a74-ba6b-6e0f298da3f0 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:34.813784 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d590d82-2a5a-4a74-ba6b-6e0f298da3f0 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:34.818216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb07b5-77e5-4152-8ea0-81db70476bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:34.819337 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb07b5-77e5-4152-8ea0-81db70476bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:34.819625 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb07b5-77e5-4152-8ea0-81db70476bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:34.819911 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb07b5-77e5-4152-8ea0-81db70476bf5 admin admin] PATH_INFO: `/v3/projects/d20cd80763f84ad5bcde9f24ede790c8` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:34.821553 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb07b5-77e5-4152-8ea0-81db70476bf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d20cd80763f84ad5bcde9f24ede790c8)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:34.874547 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: WARNING keystone.common.rbac_enforcer.enforcer [None req-79bb07b5-77e5-4152-8ea0-81db70476bf5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 25 00:40:34.874895 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb07b5-77e5-4152-8ea0-81db70476bf5 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:34.879419 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Sun Sep 25 00:40:34 2022] GET /identity/v3/projects/d20cd80763f84ad5bcde9f24ede790c8 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:36.986972 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e2efc-93db-4b74-bfa1-957e26e4d539 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:36.987497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e2efc-93db-4b74-bfa1-957e26e4d539 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:36.987497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e2efc-93db-4b74-bfa1-957e26e4d539 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:36.991592 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:40:36.997203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e0471-76da-43fa-9725-2dc973478b13 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:36.997586 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e0471-76da-43fa-9725-2dc973478b13 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:36.997882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e0471-76da-43fa-9725-2dc973478b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:37.017629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-bc9e0471-76da-43fa-9725-2dc973478b13 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:37.019143 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-bc9e0471-76da-43fa-9725-2dc973478b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:37.026897 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 25 00:40:37.292948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e2efc-93db-4b74-bfa1-957e26e4d539 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:37.305032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e2efc-93db-4b74-bfa1-957e26e4d539 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:37.309185 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3281f-38c0-4904-badb-594e9c0193a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:37.309780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3281f-38c0-4904-badb-594e9c0193a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:37.310060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3281f-38c0-4904-badb-594e9c0193a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:37.310332 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3281f-38c0-4904-badb-594e9c0193a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:37.317769 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3281f-38c0-4904-badb-594e9c0193a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:37.319521 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3281f-38c0-4904-badb-594e9c0193a8 admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:37.328311 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Sun Sep 25 00:40:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 00:40:37.333892 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e0471-76da-43fa-9725-2dc973478b13 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:37.342855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e0471-76da-43fa-9725-2dc973478b13 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:37.347783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76685cb9-0025-4b8c-b367-6afb6f02f0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:37.348401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76685cb9-0025-4b8c-b367-6afb6f02f0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:37.348713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76685cb9-0025-4b8c-b367-6afb6f02f0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:37.348994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76685cb9-0025-4b8c-b367-6afb6f02f0d8 admin admin] PATH_INFO: `/v3/users/19c04946a10143a58b50e26046837bb9` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:37.350304 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76685cb9-0025-4b8c-b367-6afb6f02f0d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=19c04946a10143a58b50e26046837bb9)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:37.352124 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76685cb9-0025-4b8c-b367-6afb6f02f0d8 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:37.353672 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Sun Sep 25 00:40:37 2022] GET /identity/v3/users/19c04946a10143a58b50e26046837bb9 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:39.577325 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e021e3-27d9-4211-b015-a38f60127bf7 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:39.577860 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e021e3-27d9-4211-b015-a38f60127bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:39.577860 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e021e3-27d9-4211-b015-a38f60127bf7 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:39.579226 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:39.584622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a2549-48df-475d-81fc-294425961c80 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:39.585022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a2549-48df-475d-81fc-294425961c80 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:39.585185 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a2549-48df-475d-81fc-294425961c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:39.603010 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-4e7a2549-48df-475d-81fc-294425961c80 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:39.603363 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0d471-deb2-4b0a-b7a6-0d1a0247dddd None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:39.603647 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0d471-deb2-4b0a-b7a6-0d1a0247dddd None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:39.603920 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0d471-deb2-4b0a-b7a6-0d1a0247dddd None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:39.604196 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-4e7a2549-48df-475d-81fc-294425961c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:39.605252 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:40:39.610965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d068c0-b268-4e7a-9ae5-5a28d289b633 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:39.611244 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d068c0-b268-4e7a-9ae5-5a28d289b633 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:39.611517 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d068c0-b268-4e7a-9ae5-5a28d289b633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:39.652494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG passlib.handlers.bcrypt [None req-20d068c0-b268-4e7a-9ae5-5a28d289b633 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81371) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 25 00:40:39.652907 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG passlib.handlers.bcrypt [None req-20d068c0-b268-4e7a-9ae5-5a28d289b633 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81371) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 25 00:40:39.685260 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:40:39.702463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-20d068c0-b268-4e7a-9ae5-5a28d289b633 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:39.704069 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-20d068c0-b268-4e7a-9ae5-5a28d289b633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:39.801632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:40:39.953907 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a2549-48df-475d-81fc-294425961c80 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:39.978066 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:40.057545 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a2549-48df-475d-81fc-294425961c80 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:40.065590 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d068c0-b268-4e7a-9ae5-5a28d289b633 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:40.091183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d65cc-2ed0-4e24-95c8-9f1ce04555e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:40.091822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d65cc-2ed0-4e24-95c8-9f1ce04555e8 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:40.092105 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d65cc-2ed0-4e24-95c8-9f1ce04555e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:40.092387 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d65cc-2ed0-4e24-95c8-9f1ce04555e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:40.103760 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d65cc-2ed0-4e24-95c8-9f1ce04555e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-b65d65cc-2ed0-4e24-95c8-9f1ce04555e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:40:40.113231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:40:40.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:40:40.114987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:40:40.114987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:40:40.114987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:40:40.114987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:40:40.114987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:40:40.114987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:40:40.114987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:40:40.114987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:40:40.114987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:40:40.114987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:40:40.114987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:40:40.114987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:40:40.114987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:40:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:40:40.120080 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d65cc-2ed0-4e24-95c8-9f1ce04555e8 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:40.165359 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d068c0-b268-4e7a-9ae5-5a28d289b633 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:40.167562 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:40.200798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:40.204217 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d01a3b-8348-48fd-97ef-3790aba60631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:40.205073 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d01a3b-8348-48fd-97ef-3790aba60631 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:40.205374 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d01a3b-8348-48fd-97ef-3790aba60631 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:40.205648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d01a3b-8348-48fd-97ef-3790aba60631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:40.219965 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d65cc-2ed0-4e24-95c8-9f1ce04555e8 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:40.253142 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f152f31-dc23-4b0b-9cb6-dacbaea21e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:40.253743 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f152f31-dc23-4b0b-9cb6-dacbaea21e83 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:40.254022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f152f31-dc23-4b0b-9cb6-dacbaea21e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:40.254297 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f152f31-dc23-4b0b-9cb6-dacbaea21e83 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:40.254965 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f152f31-dc23-4b0b-9cb6-dacbaea21e83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:40.255261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f152f31-dc23-4b0b-9cb6-dacbaea21e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:40.256671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f152f31-dc23-4b0b-9cb6-dacbaea21e83 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:40.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:40:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:40:40.272700 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d01a3b-8348-48fd-97ef-3790aba60631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:40.274228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d01a3b-8348-48fd-97ef-3790aba60631 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:40.274498 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f152f31-dc23-4b0b-9cb6-dacbaea21e83 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:40.370556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f152f31-dc23-4b0b-9cb6-dacbaea21e83 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:40.371032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:40:40.376600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d01a3b-8348-48fd-97ef-3790aba60631 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:40.379270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:40.405351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469a24a-7c0d-4100-a0ee-e2d5e97d626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:40.406073 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469a24a-7c0d-4100-a0ee-e2d5e97d626f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:40.406358 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469a24a-7c0d-4100-a0ee-e2d5e97d626f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:40.407185 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469a24a-7c0d-4100-a0ee-e2d5e97d626f None admin] PATH_INFO: `/v3/users/19c04946a10143a58b50e26046837bb9` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:40.408340 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469a24a-7c0d-4100-a0ee-e2d5e97d626f None admin] RBAC: Authorizing `identity:get_user(user_id=19c04946a10143a58b50e26046837bb9)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:40.409842 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469a24a-7c0d-4100-a0ee-e2d5e97d626f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:40.411414 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:40:40 2022] GET /identity/v3/users/19c04946a10143a58b50e26046837bb9 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:40:40.416794 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469a24a-7c0d-4100-a0ee-e2d5e97d626f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:40.430568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:40.474368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d01a3b-8348-48fd-97ef-3790aba60631 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:40.506969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dafa9-67d4-447f-b4a9-f8ff7ccf1320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:40.507820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dafa9-67d4-447f-b4a9-f8ff7ccf1320 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:40.508103 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dafa9-67d4-447f-b4a9-f8ff7ccf1320 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:40.508388 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dafa9-67d4-447f-b4a9-f8ff7ccf1320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:40.512396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469a24a-7c0d-4100-a0ee-e2d5e97d626f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:40.526930 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dafa9-67d4-447f-b4a9-f8ff7ccf1320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:40.528393 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dafa9-67d4-447f-b4a9-f8ff7ccf1320 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-149dafa9-67d4-447f-b4a9-f8ff7ccf1320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:40:40.547118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:40:40.548083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:40:40.548927 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:40:40.548927 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:40:40.548927 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:40:40.548927 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:40:40.553059 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c013ca4-fbc2-4a5e-9db3-7d8098941dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:40.553711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c013ca4-fbc2-4a5e-9db3-7d8098941dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:40.553994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c013ca4-fbc2-4a5e-9db3-7d8098941dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:40.554227 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dafa9-67d4-447f-b4a9-f8ff7ccf1320 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:40.554314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c013ca4-fbc2-4a5e-9db3-7d8098941dc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:40.555390 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c013ca4-fbc2-4a5e-9db3-7d8098941dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:40.556882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c013ca4-fbc2-4a5e-9db3-7d8098941dc7 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:40.558429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:40:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:40:40.564592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c013ca4-fbc2-4a5e-9db3-7d8098941dc7 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:40.614693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:40.645572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:40.661815 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dafa9-67d4-447f-b4a9-f8ff7ccf1320 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:40.665134 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c013ca4-fbc2-4a5e-9db3-7d8098941dc7 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:40.693864 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4405d-aed2-49c2-8279-5ef6557ded25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:40.694464 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4405d-aed2-49c2-8279-5ef6557ded25 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:40.694745 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4405d-aed2-49c2-8279-5ef6557ded25 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:40.695016 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4405d-aed2-49c2-8279-5ef6557ded25 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:40.695745 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4405d-aed2-49c2-8279-5ef6557ded25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:40.695957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4405d-aed2-49c2-8279-5ef6557ded25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:40.697372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4405d-aed2-49c2-8279-5ef6557ded25 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:40.700002 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859d4c5-ff41-4775-bc60-f615468c7413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:40.700643 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859d4c5-ff41-4775-bc60-f615468c7413 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:40.700927 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859d4c5-ff41-4775-bc60-f615468c7413 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:40.701213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859d4c5-ff41-4775-bc60-f615468c7413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:40.701940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859d4c5-ff41-4775-bc60-f615468c7413 None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.domain.id=default, user.id=19c04946a10143a58b50e26046837bb9) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:40.702251 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859d4c5-ff41-4775-bc60-f615468c7413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:40.704252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859d4c5-ff41-4775-bc60-f615468c7413 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:40.710947 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Sun Sep 25 00:40:40 2022] GET /identity/v3/role_assignments?user.id=19c04946a10143a58b50e26046837bb9&scope.domain.id=default&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:40:40.714897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:43.232426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bac54-850a-47f8-a9a9-8957c8dec505 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:43.233482 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bac54-850a-47f8-a9a9-8957c8dec505 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:43.233967 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bac54-850a-47f8-a9a9-8957c8dec505 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:43.235823 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:43.240946 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff52b-14d4-4cdf-9017-02d816fce02e None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:43.241761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff52b-14d4-4cdf-9017-02d816fce02e None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:43.242326 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff52b-14d4-4cdf-9017-02d816fce02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:43.249648 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6538540-2f78-4bd9-b72f-8bf26657d105 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:43.250180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6538540-2f78-4bd9-b72f-8bf26657d105 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:43.250726 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6538540-2f78-4bd9-b72f-8bf26657d105 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:43.252778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 13/23] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:40:43.258068 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457e43e-02ae-4937-980c-8852cbd2b9ce None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:43.258580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457e43e-02ae-4937-980c-8852cbd2b9ce None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:43.259064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457e43e-02ae-4937-980c-8852cbd2b9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:43.281463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-46eff52b-14d4-4cdf-9017-02d816fce02e None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:43.283591 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-46eff52b-14d4-4cdf-9017-02d816fce02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:43.295899 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-a457e43e-02ae-4937-980c-8852cbd2b9ce None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:43.297428 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-a457e43e-02ae-4937-980c-8852cbd2b9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:43.435040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 11/24] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:40:43.458873 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 14/25] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:40:43.617091 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d60b3-461e-45d5-91e8-be1f3d488b29 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:43.617603 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d60b3-461e-45d5-91e8-be1f3d488b29 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:43.618030 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d60b3-461e-45d5-91e8-be1f3d488b29 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:43.619527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 12/26] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:43.625045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c77e2-ef22-4209-9777-abc4a8c8e5d2 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:43.626112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c77e2-ef22-4209-9777-abc4a8c8e5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:43.626606 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c77e2-ef22-4209-9777-abc4a8c8e5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:43.653577 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-891c77e2-ef22-4209-9777-abc4a8c8e5d2 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:43.655191 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-891c77e2-ef22-4209-9777-abc4a8c8e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:43.742341 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 15/27] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:40:43.751011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d60b3-461e-45d5-91e8-be1f3d488b29 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:43.836238 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:43.906165 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d60b3-461e-45d5-91e8-be1f3d488b29 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:43.928386 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c77e2-ef22-4209-9777-abc4a8c8e5d2 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:43.938904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:43.952381 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6d859-6c9e-4086-a677-b1b1d1699a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:43.952920 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6d859-6c9e-4086-a677-b1b1d1699a7f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:43.953207 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6d859-6c9e-4086-a677-b1b1d1699a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:43.953528 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6d859-6c9e-4086-a677-b1b1d1699a7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:43.973682 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6d859-6c9e-4086-a677-b1b1d1699a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-81e6d859-6c9e-4086-a677-b1b1d1699a7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:40:43.980707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:40:43.981618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:40:43.982384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:40:43.982384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:40:43.982384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:40:43.982384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:40:43.982384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:40:43.982384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:40:43.982384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:40:43.982384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:40:43.982384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:40:43.982384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:40:43.982384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:40:43.982384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:40:43.987329 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 13/28] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:40:43.991053 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6d859-6c9e-4086-a677-b1b1d1699a7f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:44.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c77e2-ef22-4209-9777-abc4a8c8e5d2 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:44.162148 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6d859-6c9e-4086-a677-b1b1d1699a7f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:44.182587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:44.203718 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e0be2-1a3f-44c7-8e31-08a4149fc44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:44.204340 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0be2-1a3f-44c7-8e31-08a4149fc44b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:44.204650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0be2-1a3f-44c7-8e31-08a4149fc44b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:44.204977 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0be2-1a3f-44c7-8e31-08a4149fc44b None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:44.205883 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e0be2-1a3f-44c7-8e31-08a4149fc44b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:44.206195 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e0be2-1a3f-44c7-8e31-08a4149fc44b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:44.207620 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e0be2-1a3f-44c7-8e31-08a4149fc44b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:44.221463 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8d044-08bd-4f58-bfd6-d41f4dfd085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:44.221665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 14/29] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:40:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:40:44.222535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8d044-08bd-4f58-bfd6-d41f4dfd085b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:44.222744 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ced415-3d2a-4589-a6c6-949b2ee83e16 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:44.223034 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ced415-3d2a-4589-a6c6-949b2ee83e16 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:44.223313 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ced415-3d2a-4589-a6c6-949b2ee83e16 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:44.223616 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8d044-08bd-4f58-bfd6-d41f4dfd085b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:44.224089 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8d044-08bd-4f58-bfd6-d41f4dfd085b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:44.224496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 15/30] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:44.228596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ced415-3d2a-4589-a6c6-949b2ee83e16 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:44.240937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8d044-08bd-4f58-bfd6-d41f4dfd085b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:44.243179 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8d044-08bd-4f58-bfd6-d41f4dfd085b None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-1ee8d044-08bd-4f58-bfd6-d41f4dfd085b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:40:44.261540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:40:44.262412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:40:44.263190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:40:44.263190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:40:44.263190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:40:44.265109 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 16/31] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:40:44.266180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8d044-08bd-4f58-bfd6-d41f4dfd085b None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:44.347112 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ced415-3d2a-4589-a6c6-949b2ee83e16 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:44.362761 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:44.386489 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba94876-5a3b-4dfe-b3d9-36f9ea60912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:44.387102 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba94876-5a3b-4dfe-b3d9-36f9ea60912e None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:44.387384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba94876-5a3b-4dfe-b3d9-36f9ea60912e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:44.387660 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba94876-5a3b-4dfe-b3d9-36f9ea60912e None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:44.388330 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba94876-5a3b-4dfe-b3d9-36f9ea60912e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:44.389868 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba94876-5a3b-4dfe-b3d9-36f9ea60912e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:44.421131 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8d044-08bd-4f58-bfd6-d41f4dfd085b None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:44.458208 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86837b0-6dfa-476e-9734-3d2ed53bb352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:44.459224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86837b0-6dfa-476e-9734-3d2ed53bb352 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:44.459739 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86837b0-6dfa-476e-9734-3d2ed53bb352 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:44.460208 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86837b0-6dfa-476e-9734-3d2ed53bb352 None admin] PATH_INFO: `/v3/users/19c04946a10143a58b50e26046837bb9` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:44.461673 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86837b0-6dfa-476e-9734-3d2ed53bb352 None admin] RBAC: Authorizing `identity:get_user(user_id=19c04946a10143a58b50e26046837bb9)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:44.463350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86837b0-6dfa-476e-9734-3d2ed53bb352 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:44.465609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 17/32] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:40:44 2022] GET /identity/v3/users/19c04946a10143a58b50e26046837bb9 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:44.467212 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd084d21-ba81-4042-bc05-59a20296f415 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:44.467756 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd084d21-ba81-4042-bc05-59a20296f415 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:44.468281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd084d21-ba81-4042-bc05-59a20296f415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:44.491584 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-bd084d21-ba81-4042-bc05-59a20296f415 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:44.493330 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-bd084d21-ba81-4042-bc05-59a20296f415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:44.530474 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 16/33] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Sep 25 00:40:44 2022] POST /identity/v3/roles => generated 225 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:40:44.531472 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba94876-5a3b-4dfe-b3d9-36f9ea60912e None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:44.604157 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 18/34] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:40:44.604949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:44.608660 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd084d21-ba81-4042-bc05-59a20296f415 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:44.736394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba94876-5a3b-4dfe-b3d9-36f9ea60912e None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:44.763362 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:44.783332 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a4579-60b1-4880-aa40-2a4e63651f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:44.785118 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a4579-60b1-4880-aa40-2a4e63651f53 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:44.786264 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a4579-60b1-4880-aa40-2a4e63651f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:44.786916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a4579-60b1-4880-aa40-2a4e63651f53 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:44.789579 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a4579-60b1-4880-aa40-2a4e63651f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:44.790094 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a4579-60b1-4880-aa40-2a4e63651f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:44.793583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a4579-60b1-4880-aa40-2a4e63651f53 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:44.816527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 17/35] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:44.825630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a4579-60b1-4880-aa40-2a4e63651f53 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:44.862620 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd084d21-ba81-4042-bc05-59a20296f415 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:44.903180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759d2f4-f44e-451a-8218-9d4f02308031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:44.903829 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759d2f4-f44e-451a-8218-9d4f02308031 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:44.904110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759d2f4-f44e-451a-8218-9d4f02308031 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:44.904390 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759d2f4-f44e-451a-8218-9d4f02308031 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:44.905554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759d2f4-f44e-451a-8218-9d4f02308031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:44.907823 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759d2f4-f44e-451a-8218-9d4f02308031 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:44.909526 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 19/36] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:40:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:44.910741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0bc52-db4f-4aac-adb8-450c76a04c97 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:44.911035 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0bc52-db4f-4aac-adb8-450c76a04c97 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:44.911312 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0bc52-db4f-4aac-adb8-450c76a04c97 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:44.912835 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 20/37] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:44.917471 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0bc52-db4f-4aac-adb8-450c76a04c97 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:44.932999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:44.948612 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a4579-60b1-4880-aa40-2a4e63651f53 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:44.989155 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f289867-e4f1-4beb-9aaa-0087e4083158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:44.989717 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f289867-e4f1-4beb-9aaa-0087e4083158 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:44.989995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f289867-e4f1-4beb-9aaa-0087e4083158 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:44.990269 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f289867-e4f1-4beb-9aaa-0087e4083158 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:44.991428 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f289867-e4f1-4beb-9aaa-0087e4083158 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:44.993581 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f289867-e4f1-4beb-9aaa-0087e4083158 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:45.026563 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 18/38] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Sep 25 00:40:44 2022] POST /identity/v3/projects => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:40:45.030147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50598af4-d321-4bc3-a39f-d57264395ed3 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:45.030487 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50598af4-d321-4bc3-a39f-d57264395ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:45.030891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50598af4-d321-4bc3-a39f-d57264395ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:45.049267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0bc52-db4f-4aac-adb8-450c76a04c97 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:45.055153 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-50598af4-d321-4bc3-a39f-d57264395ed3 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:45.057080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-50598af4-d321-4bc3-a39f-d57264395ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:45.083860 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:45.102589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e90851-6750-4c12-82ab-3fa195405547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:45.103686 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e90851-6750-4c12-82ab-3fa195405547 None admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:45.104264 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e90851-6750-4c12-82ab-3fa195405547 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:45.104867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e90851-6750-4c12-82ab-3fa195405547 None admin] PATH_INFO: `/v3/domains/default/users/19c04946a10143a58b50e26046837bb9/roles/a6d585feb70946b1b1ebcaece17d26b2` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:45.107504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e90851-6750-4c12-82ab-3fa195405547 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=19c04946a10143a58b50e26046837bb9, role_id=a6d585feb70946b1b1ebcaece17d26b2)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:45.109643 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e90851-6750-4c12-82ab-3fa195405547 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:45.150315 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 19/39] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:40:45.157965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50598af4-d321-4bc3-a39f-d57264395ed3 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:45.250849 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:45.260384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 21/40] 10.222.0.27 () {58 vars in 1361 bytes} [Sun Sep 25 00:40:44 2022] PUT /identity/v3/domains/default/users/19c04946a10143a58b50e26046837bb9/roles/a6d585feb70946b1b1ebcaece17d26b2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:40:45.262448 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1470d-78a2-4db9-9062-f1f0cbe7b4ca None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:45.262823 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1470d-78a2-4db9-9062-f1f0cbe7b4ca None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:45.263333 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1470d-78a2-4db9-9062-f1f0cbe7b4ca None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:45.270555 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 22/41] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:45.276159 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24f29a-6935-473a-a20d-12d3d1b8f47e None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:45.276449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24f29a-6935-473a-a20d-12d3d1b8f47e None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:45.276771 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24f29a-6935-473a-a20d-12d3d1b8f47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:45.291361 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50598af4-d321-4bc3-a39f-d57264395ed3 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:45.299120 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-5c24f29a-6935-473a-a20d-12d3d1b8f47e None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:45.301711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-5c24f29a-6935-473a-a20d-12d3d1b8f47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:45.345761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c32c4-edbf-4aed-960d-ab3d1b7f5854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:45.346421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c32c4-edbf-4aed-960d-ab3d1b7f5854 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:45.346706 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c32c4-edbf-4aed-960d-ab3d1b7f5854 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:45.346996 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c32c4-edbf-4aed-960d-ab3d1b7f5854 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:45.347764 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c32c4-edbf-4aed-960d-ab3d1b7f5854 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:45.349266 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c32c4-edbf-4aed-960d-ab3d1b7f5854 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:45.370729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 20/42] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Sep 25 00:40:45 2022] POST /identity/v3/roles => generated 219 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:40:45.394263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 23/43] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:40:45.474537 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c32c4-edbf-4aed-960d-ab3d1b7f5854 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:45.595897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c32c4-edbf-4aed-960d-ab3d1b7f5854 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:45.626691 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:45.633912 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9e7ee-22b8-41ed-83be-42b13f7dadc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:45.634885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e7ee-22b8-41ed-83be-42b13f7dadc0 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:45.635685 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e7ee-22b8-41ed-83be-42b13f7dadc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:45.636239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e7ee-22b8-41ed-83be-42b13f7dadc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:45.637004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9e7ee-22b8-41ed-83be-42b13f7dadc0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:45.638513 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9e7ee-22b8-41ed-83be-42b13f7dadc0 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:45.654340 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 21/44] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Sep 25 00:40:45 2022] POST /identity/v3/roles => generated 223 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:40:45.668509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24f29a-6935-473a-a20d-12d3d1b8f47e None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:45.778975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24f29a-6935-473a-a20d-12d3d1b8f47e None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:45.900898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:45.923358 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642c19-7856-475d-98e3-b2188fab3663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:45.923995 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642c19-7856-475d-98e3-b2188fab3663 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:45.924278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642c19-7856-475d-98e3-b2188fab3663 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:45.924572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642c19-7856-475d-98e3-b2188fab3663 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:45.925701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27642c19-7856-475d-98e3-b2188fab3663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:45.927298 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27642c19-7856-475d-98e3-b2188fab3663 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:45.928895 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 24/45] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:40:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:45.935510 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9e7ee-22b8-41ed-83be-42b13f7dadc0 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:46.034357 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9e7ee-22b8-41ed-83be-42b13f7dadc0 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:46.066738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb540ff-fdf6-4e32-8a85-41ce8e3c8f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:46.067348 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb540ff-fdf6-4e32-8a85-41ce8e3c8f16 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:46.067632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb540ff-fdf6-4e32-8a85-41ce8e3c8f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:46.067911 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb540ff-fdf6-4e32-8a85-41ce8e3c8f16 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:46.068615 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb540ff-fdf6-4e32-8a85-41ce8e3c8f16 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:46.070073 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb540ff-fdf6-4e32-8a85-41ce8e3c8f16 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:46.096178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 22/46] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Sep 25 00:40:45 2022] POST /identity/v3/projects => generated 312 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:40:47.484316 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefbd10-9b4e-42fe-80ef-34060daec489 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:47.485404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefbd10-9b4e-42fe-80ef-34060daec489 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:47.485509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefbd10-9b4e-42fe-80ef-34060daec489 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:47.486811 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 25/47] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:47.492187 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d4b6-fad8-40eb-8752-f699191e9852 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:47.492604 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d4b6-fad8-40eb-8752-f699191e9852 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:47.492752 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d4b6-fad8-40eb-8752-f699191e9852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:47.510355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-d724d4b6-fad8-40eb-8752-f699191e9852 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:47.511533 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-d724d4b6-fad8-40eb-8752-f699191e9852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:47.545075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:47.579281 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:40:47.854997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefbd10-9b4e-42fe-80ef-34060daec489 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:47.955588 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefbd10-9b4e-42fe-80ef-34060daec489 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:47.989031 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e603e-6aa7-4ba6-bd0d-09b7cdade66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:47.989670 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e603e-6aa7-4ba6-bd0d-09b7cdade66b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:47.989955 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e603e-6aa7-4ba6-bd0d-09b7cdade66b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:47.990235 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e603e-6aa7-4ba6-bd0d-09b7cdade66b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:48.000614 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e603e-6aa7-4ba6-bd0d-09b7cdade66b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-633e603e-6aa7-4ba6-bd0d-09b7cdade66b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:40:48.005462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:40:48.006439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:40:48.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:40:48.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:40:48.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:40:48.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:40:48.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:40:48.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:40:48.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:40:48.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:40:48.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:40:48.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:40:48.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:40:48.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:40:48.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 26/49] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:40:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:40:48.012313 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d4b6-fad8-40eb-8752-f699191e9852 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:48.107133 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d4b6-fad8-40eb-8752-f699191e9852 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:48.144177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ca362-bb56-4678-abbf-f68f33f8ee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:48.144837 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ca362-bb56-4678-abbf-f68f33f8ee8e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:48.145121 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ca362-bb56-4678-abbf-f68f33f8ee8e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:48.145397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ca362-bb56-4678-abbf-f68f33f8ee8e None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:48.146077 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ca362-bb56-4678-abbf-f68f33f8ee8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:48.146383 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ca362-bb56-4678-abbf-f68f33f8ee8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:48.147792 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ca362-bb56-4678-abbf-f68f33f8ee8e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:48.156489 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 24/50] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:48.162165 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e603e-6aa7-4ba6-bd0d-09b7cdade66b None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:48.203111 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:48.237711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee02ef-35d6-4649-ae15-571c033bde44 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:48.237999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee02ef-35d6-4649-ae15-571c033bde44 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:48.238281 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee02ef-35d6-4649-ae15-571c033bde44 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:48.239992 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 25/51] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:40:48.244972 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422776f-dd88-4fb3-86a3-e0aa4a919964 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:48.245258 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422776f-dd88-4fb3-86a3-e0aa4a919964 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:48.245535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422776f-dd88-4fb3-86a3-e0aa4a919964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:48.262852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e603e-6aa7-4ba6-bd0d-09b7cdade66b None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:48.298834 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ef810-e409-40eb-b6ba-f7f9d1b88b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:48.299490 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ef810-e409-40eb-b6ba-f7f9d1b88b02 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:48.299770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ef810-e409-40eb-b6ba-f7f9d1b88b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:48.300048 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ef810-e409-40eb-b6ba-f7f9d1b88b02 None admin] PATH_INFO: `/v3/users/19c04946a10143a58b50e26046837bb9` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:48.301261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ef810-e409-40eb-b6ba-f7f9d1b88b02 None admin] RBAC: Authorizing `identity:get_user(user_id=19c04946a10143a58b50e26046837bb9)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:48.302790 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ef810-e409-40eb-b6ba-f7f9d1b88b02 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:48.304452 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 27/52] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:40:48 2022] GET /identity/v3/users/19c04946a10143a58b50e26046837bb9 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:48.310107 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ef810-e409-40eb-b6ba-f7f9d1b88b02 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:48.368199 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-e422776f-dd88-4fb3-86a3-e0aa4a919964 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:48.369349 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-e422776f-dd88-4fb3-86a3-e0aa4a919964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:48.395783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:48.411444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ef810-e409-40eb-b6ba-f7f9d1b88b02 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:48.420034 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:48.436046 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 26/53] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:40:48.445829 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2598-4810-49a1-b965-9e2cb498733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:48.446472 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2598-4810-49a1-b965-9e2cb498733f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:48.446754 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2598-4810-49a1-b965-9e2cb498733f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:48.447032 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2598-4810-49a1-b965-9e2cb498733f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:48.448428 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a2598-4810-49a1-b965-9e2cb498733f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:48.449912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a2598-4810-49a1-b965-9e2cb498733f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:48.451473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 28/54] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:40:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:40:48.457171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422776f-dd88-4fb3-86a3-e0aa4a919964 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:48.551341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422776f-dd88-4fb3-86a3-e0aa4a919964 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:48.583712 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40f971-c8c5-4d98-8000-2230ab94fade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:48.584311 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f971-c8c5-4d98-8000-2230ab94fade None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:48.584619 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f971-c8c5-4d98-8000-2230ab94fade None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:48.584900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f971-c8c5-4d98-8000-2230ab94fade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:48.585617 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40f971-c8c5-4d98-8000-2230ab94fade None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.domain.id=default, user.id=19c04946a10143a58b50e26046837bb9) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:48.585925 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40f971-c8c5-4d98-8000-2230ab94fade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:48.587362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40f971-c8c5-4d98-8000-2230ab94fade None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:48.595752 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1322 bytes} [Sun Sep 25 00:40:48 2022] GET /identity/v3/role_assignments?user.id=19c04946a10143a58b50e26046837bb9&scope.domain.id=default&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:40:48.704152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2598-4810-49a1-b965-9e2cb498733f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:48.808528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2598-4810-49a1-b965-9e2cb498733f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:48.845897 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd958f-97b7-4d6e-bf3b-b5b8da7208b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:48.846538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd958f-97b7-4d6e-bf3b-b5b8da7208b0 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:48.846822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd958f-97b7-4d6e-bf3b-b5b8da7208b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:48.847100 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd958f-97b7-4d6e-bf3b-b5b8da7208b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:48.848203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd958f-97b7-4d6e-bf3b-b5b8da7208b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:48.849713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd958f-97b7-4d6e-bf3b-b5b8da7208b0 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:48.851281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 29/56] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:40:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:48.856912 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40f971-c8c5-4d98-8000-2230ab94fade None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:48.885113 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:48.955201 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40f971-c8c5-4d98-8000-2230ab94fade None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:48.994799 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09e160-e907-45c0-9f76-ff7fbb7fb8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:48.995401 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09e160-e907-45c0-9f76-ff7fbb7fb8da None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:48.995693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09e160-e907-45c0-9f76-ff7fbb7fb8da None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:48.995953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09e160-e907-45c0-9f76-ff7fbb7fb8da None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:48.996634 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09e160-e907-45c0-9f76-ff7fbb7fb8da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:48.998071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09e160-e907-45c0-9f76-ff7fbb7fb8da None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:49.022426 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 28/57] 10.222.0.27 () {60 vars in 1140 bytes} [Sun Sep 25 00:40:48 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:40:51.161871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bd03e-52c0-46f1-bb1e-f90fd52258fb None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:51.162355 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bd03e-52c0-46f1-bb1e-f90fd52258fb None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:51.162435 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bd03e-52c0-46f1-bb1e-f90fd52258fb None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:51.163782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 30/58] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:51.169019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dce45-4c90-4961-a6e5-0a6950e1b056 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:51.169445 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dce45-4c90-4961-a6e5-0a6950e1b056 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:51.169586 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dce45-4c90-4961-a6e5-0a6950e1b056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:51.187142 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-373dce45-4c90-4961-a6e5-0a6950e1b056 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:51.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-373dce45-4c90-4961-a6e5-0a6950e1b056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:51.252354 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 29/59] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:40:51.516929 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bd03e-52c0-46f1-bb1e-f90fd52258fb None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:51.567051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:51.619734 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bd03e-52c0-46f1-bb1e-f90fd52258fb None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:51.651531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cb06e-481b-4205-8da0-12ee43a90103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:51.652154 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cb06e-481b-4205-8da0-12ee43a90103 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:51.652439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cb06e-481b-4205-8da0-12ee43a90103 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:51.652747 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cb06e-481b-4205-8da0-12ee43a90103 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:51.653866 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cb06e-481b-4205-8da0-12ee43a90103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:51.655320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cb06e-481b-4205-8da0-12ee43a90103 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:51.656918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 31/60] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:40:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:51.662430 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dce45-4c90-4961-a6e5-0a6950e1b056 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:51.674143 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:51.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dce45-4c90-4961-a6e5-0a6950e1b056 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:51.792250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f4aee-4302-44f7-9107-f0df06f14782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:51.792827 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f4aee-4302-44f7-9107-f0df06f14782 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:51.793109 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f4aee-4302-44f7-9107-f0df06f14782 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:51.793387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f4aee-4302-44f7-9107-f0df06f14782 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:51.794033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f4aee-4302-44f7-9107-f0df06f14782 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:51.795486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f4aee-4302-44f7-9107-f0df06f14782 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:51.821845 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 30/61] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:40:51 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:40:54.968002 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dcb9f-a63d-4cfe-91c9-13bd1225acf7 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:54.969054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dcb9f-a63d-4cfe-91c9-13bd1225acf7 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:54.969562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dcb9f-a63d-4cfe-91c9-13bd1225acf7 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:54.971236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 32/62] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:54.976869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a688043-9141-4fc4-afd3-70a985f52889 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:54.977711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a688043-9141-4fc4-afd3-70a985f52889 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:54.978184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a688043-9141-4fc4-afd3-70a985f52889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:55.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-5a688043-9141-4fc4-afd3-70a985f52889 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:55.007408 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-5a688043-9141-4fc4-afd3-70a985f52889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:55.095931 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:55.103608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 31/63] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:40:55.460749 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ad3f2-f5be-41bf-bcfe-8716064fb1e7 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:55.461119 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ad3f2-f5be-41bf-bcfe-8716064fb1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:55.461335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ad3f2-f5be-41bf-bcfe-8716064fb1e7 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:55.462664 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 33/64] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:55.479989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ec7c4-b3e0-415d-87a9-1f6a93ee3fab None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:55.480631 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ec7c4-b3e0-415d-87a9-1f6a93ee3fab None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:55.481110 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ec7c4-b3e0-415d-87a9-1f6a93ee3fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:55.505549 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86ba96-9805-4105-aa58-f853476ca3fc None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:55.506180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86ba96-9805-4105-aa58-f853476ca3fc None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:55.506656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86ba96-9805-4105-aa58-f853476ca3fc None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:55.508192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 34/65] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:55.509640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-500ec7c4-b3e0-415d-87a9-1f6a93ee3fab None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:55.511040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-500ec7c4-b3e0-415d-87a9-1f6a93ee3fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:55.513074 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74efcf-97ef-4a63-bf81-7c0824079cf6 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:55.513560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74efcf-97ef-4a63-bf81-7c0824079cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:55.514028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74efcf-97ef-4a63-bf81-7c0824079cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:55.533786 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-9b74efcf-97ef-4a63-bf81-7c0824079cf6 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:55.535303 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-9b74efcf-97ef-4a63-bf81-7c0824079cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:55.600369 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 32/66] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:40:55.604683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934838-b88d-44ec-b808-9de084beb735 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:55.604683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934838-b88d-44ec-b808-9de084beb735 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:55.604683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934838-b88d-44ec-b808-9de084beb735 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:55.605014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 33/67] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:55.605983 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e934838-b88d-44ec-b808-9de084beb735 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:55.621614 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 35/68] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:40:55.628212 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bc2dd-7e7d-4b79-a67c-4f154e6a8c04 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:55.628212 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bc2dd-7e7d-4b79-a67c-4f154e6a8c04 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:55.628212 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bc2dd-7e7d-4b79-a67c-4f154e6a8c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:55.662541 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-471bc2dd-7e7d-4b79-a67c-4f154e6a8c04 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:55.663733 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-471bc2dd-7e7d-4b79-a67c-4f154e6a8c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:55.730763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:55.760342 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e934838-b88d-44ec-b808-9de084beb735 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:55.764677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 36/69] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:40:55.766663 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10429dbf-871f-4b37-90e1-0e9b11c0290a None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:55.767113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10429dbf-871f-4b37-90e1-0e9b11c0290a None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:55.767537 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10429dbf-871f-4b37-90e1-0e9b11c0290a None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:55.768940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 37/70] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:55.774758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c23bc-aa71-4318-9256-31a836b1a893 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:55.775239 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c23bc-aa71-4318-9256-31a836b1a893 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:55.775705 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c23bc-aa71-4318-9256-31a836b1a893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:55.794876 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-c40c23bc-aa71-4318-9256-31a836b1a893 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:55.796330 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-c40c23bc-aa71-4318-9256-31a836b1a893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:55.801615 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:55.824041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f036722-cdd8-4f0e-afad-9743fa39ea55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:55.826002 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036722-cdd8-4f0e-afad-9743fa39ea55 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:55.826294 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036722-cdd8-4f0e-afad-9743fa39ea55 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:55.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036722-cdd8-4f0e-afad-9743fa39ea55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:55.845965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f036722-cdd8-4f0e-afad-9743fa39ea55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-5f036722-cdd8-4f0e-afad-9743fa39ea55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:40:55.850820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:40:55.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:40:55.852412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:40:55.852412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:40:55.852412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:40:55.852412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:40:55.852412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:40:55.852412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:40:55.852412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:40:55.852412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:40:55.852412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:40:55.852412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:40:55.852412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:40:55.852412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:40:55.852412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 34/71] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:40:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:40:55.859189 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f036722-cdd8-4f0e-afad-9743fa39ea55 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:55.918322 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 38/72] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:40:55.919882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c23bc-aa71-4318-9256-31a836b1a893 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:55.980939 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f036722-cdd8-4f0e-afad-9743fa39ea55 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:56.022058 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc5473-e10d-40a5-89e0-43cada1c60af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:56.022671 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc5473-e10d-40a5-89e0-43cada1c60af None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:56.022951 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc5473-e10d-40a5-89e0-43cada1c60af None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:56.023230 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc5473-e10d-40a5-89e0-43cada1c60af None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:56.023891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc5473-e10d-40a5-89e0-43cada1c60af None admin] RBAC: Adding query filter params (name=member) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:56.024195 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc5473-e10d-40a5-89e0-43cada1c60af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:56.025620 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc5473-e10d-40a5-89e0-43cada1c60af None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:56.036100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 35/73] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:40:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:56.041443 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc5473-e10d-40a5-89e0-43cada1c60af None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:56.065696 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c23bc-aa71-4318-9256-31a836b1a893 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:56.067221 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:56.101661 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa15667-e316-4a8e-b264-ed16b61e2628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:56.102405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa15667-e316-4a8e-b264-ed16b61e2628 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:56.102630 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa15667-e316-4a8e-b264-ed16b61e2628 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:56.102909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa15667-e316-4a8e-b264-ed16b61e2628 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:56.103855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:56.114034 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa15667-e316-4a8e-b264-ed16b61e2628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-7fa15667-e316-4a8e-b264-ed16b61e2628 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:40:56.118855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:40:56.119674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:40:56.120478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:40:56.120478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:40:56.120478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:40:56.120478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:40:56.120478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:40:56.120478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:40:56.120478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:40:56.120478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:40:56.120478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:40:56.120478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:40:56.120478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:40:56.120478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:40:56.120478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 39/74] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:40:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:40:56.121802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa15667-e316-4a8e-b264-ed16b61e2628 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:56.162893 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc5473-e10d-40a5-89e0-43cada1c60af None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:56.196888 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96a4e0-1179-4c5d-9a1e-53b7efaac38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:56.197522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96a4e0-1179-4c5d-9a1e-53b7efaac38a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:56.197801 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96a4e0-1179-4c5d-9a1e-53b7efaac38a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:56.198329 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96a4e0-1179-4c5d-9a1e-53b7efaac38a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:56.208716 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96a4e0-1179-4c5d-9a1e-53b7efaac38a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-eb96a4e0-1179-4c5d-9a1e-53b7efaac38a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:40:56.214092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:40:56.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:40:56.215656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:40:56.215656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:40:56.215656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:40:56.215656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:40:56.215656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:40:56.215656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:40:56.215656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:40:56.215656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:40:56.215656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:40:56.215656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:40:56.215656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:40:56.215656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:40:56.215656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 36/75] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:40:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:40:56.216306 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96a4e0-1179-4c5d-9a1e-53b7efaac38a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:56.230637 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa15667-e316-4a8e-b264-ed16b61e2628 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:56.265040 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650833b-0935-4623-8474-80b5d9957a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:56.265611 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650833b-0935-4623-8474-80b5d9957a48 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:56.265921 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650833b-0935-4623-8474-80b5d9957a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:56.266206 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650833b-0935-4623-8474-80b5d9957a48 None admin] PATH_INFO: `/v3/users/7e42be56f2284bb4ae4095ef96479453` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:56.279114 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650833b-0935-4623-8474-80b5d9957a48 None admin] RBAC: Authorizing `identity:get_user(user_id=7e42be56f2284bb4ae4095ef96479453)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:56.280638 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650833b-0935-4623-8474-80b5d9957a48 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:56.282772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 40/76] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:40:56 2022] GET /identity/v3/users/7e42be56f2284bb4ae4095ef96479453 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:56.288015 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650833b-0935-4623-8474-80b5d9957a48 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:56.309321 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:56.315339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96a4e0-1179-4c5d-9a1e-53b7efaac38a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:56.324518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:56.348970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7df03-15af-4fea-bb07-903c38ea6139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:56.349608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7df03-15af-4fea-bb07-903c38ea6139 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:56.349893 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7df03-15af-4fea-bb07-903c38ea6139 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:56.350170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7df03-15af-4fea-bb07-903c38ea6139 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:56.360434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7df03-15af-4fea-bb07-903c38ea6139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-22a7df03-15af-4fea-bb07-903c38ea6139 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:40:56.365707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:40:56.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:40:56.367279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:40:56.367279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:40:56.367279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:40:56.367279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:40:56.367279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:40:56.367279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:40:56.367279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:40:56.367279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:40:56.367279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:40:56.367279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:40:56.367279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:40:56.367279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:40:56.367279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 37/77] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:40:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:40:56.367928 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7df03-15af-4fea-bb07-903c38ea6139 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:56.388464 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650833b-0935-4623-8474-80b5d9957a48 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:56.421782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebf6c9-d5a7-4369-ba8e-4d3678c143d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:56.422933 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf6c9-d5a7-4369-ba8e-4d3678c143d6 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:56.423225 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf6c9-d5a7-4369-ba8e-4d3678c143d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:56.423499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf6c9-d5a7-4369-ba8e-4d3678c143d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:56.424170 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebf6c9-d5a7-4369-ba8e-4d3678c143d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:56.424476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebf6c9-d5a7-4369-ba8e-4d3678c143d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:56.425895 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebf6c9-d5a7-4369-ba8e-4d3678c143d6 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:56.433746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 41/78] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:56.434533 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebf6c9-d5a7-4369-ba8e-4d3678c143d6 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:56.464666 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7df03-15af-4fea-bb07-903c38ea6139 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:56.499062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a67d3-d925-43bf-914b-3fa67879fdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:56.499691 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a67d3-d925-43bf-914b-3fa67879fdfb None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:56.499977 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a67d3-d925-43bf-914b-3fa67879fdfb None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:56.500281 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a67d3-d925-43bf-914b-3fa67879fdfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:56.501458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a67d3-d925-43bf-914b-3fa67879fdfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:56.502912 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a67d3-d925-43bf-914b-3fa67879fdfb None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:56.504473 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 38/79] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:40:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:56.505264 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a67d3-d925-43bf-914b-3fa67879fdfb None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:56.517656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:56.536009 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebf6c9-d5a7-4369-ba8e-4d3678c143d6 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:56.538691 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:56.569808 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af73448-2e94-4741-84b4-fd2df3b40d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:56.570428 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af73448-2e94-4741-84b4-fd2df3b40d56 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:56.570710 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af73448-2e94-4741-84b4-fd2df3b40d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:56.570991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af73448-2e94-4741-84b4-fd2df3b40d56 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:56.571656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af73448-2e94-4741-84b4-fd2df3b40d56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:56.571963 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af73448-2e94-4741-84b4-fd2df3b40d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:56.573629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af73448-2e94-4741-84b4-fd2df3b40d56 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:56.581857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 42/80] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:40:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:56.582644 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af73448-2e94-4741-84b4-fd2df3b40d56 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:56.607183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a67d3-d925-43bf-914b-3fa67879fdfb None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:56.639683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06e761-724b-45b5-9625-c8c031b0cf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:56.640289 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06e761-724b-45b5-9625-c8c031b0cf86 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:56.640599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06e761-724b-45b5-9625-c8c031b0cf86 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:56.640943 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06e761-724b-45b5-9625-c8c031b0cf86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:56.678904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af73448-2e94-4741-84b4-fd2df3b40d56 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:56.705981 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06e761-724b-45b5-9625-c8c031b0cf86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:56.707444 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06e761-724b-45b5-9625-c8c031b0cf86 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:56.712849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3ee07-565a-4f4b-ad02-d0db4d9aa0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:56.713452 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3ee07-565a-4f4b-ad02-d0db4d9aa0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:56.713737 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3ee07-565a-4f4b-ad02-d0db4d9aa0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:56.714016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3ee07-565a-4f4b-ad02-d0db4d9aa0d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:56.714685 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3ee07-565a-4f4b-ad02-d0db4d9aa0d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:56.714994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3ee07-565a-4f4b-ad02-d0db4d9aa0d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:56.716350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3ee07-565a-4f4b-ad02-d0db4d9aa0d6 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:56.724306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 43/81] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:40:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:56.725124 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3ee07-565a-4f4b-ad02-d0db4d9aa0d6 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:56.733686 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:56.743313 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:56.806488 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 39/82] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:40:56.807166 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06e761-724b-45b5-9625-c8c031b0cf86 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:56.832206 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3ee07-565a-4f4b-ad02-d0db4d9aa0d6 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:56.866569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a10e0-3d01-4406-8ec4-647a360cc666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:56.867207 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a10e0-3d01-4406-8ec4-647a360cc666 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:56.867490 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a10e0-3d01-4406-8ec4-647a360cc666 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:56.867772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a10e0-3d01-4406-8ec4-647a360cc666 None admin] PATH_INFO: `/v3/users/19c04946a10143a58b50e26046837bb9` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:56.868949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a10e0-3d01-4406-8ec4-647a360cc666 None admin] RBAC: Authorizing `identity:get_user(user_id=19c04946a10143a58b50e26046837bb9)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:56.870429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a10e0-3d01-4406-8ec4-647a360cc666 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:56.872000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 44/83] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:40:56 2022] GET /identity/v3/users/19c04946a10143a58b50e26046837bb9 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:56.872784 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a10e0-3d01-4406-8ec4-647a360cc666 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:56.910061 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06e761-724b-45b5-9625-c8c031b0cf86 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:56.943290 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a979f5f-bb78-434e-8a02-7cd47d852677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:56.943900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a979f5f-bb78-434e-8a02-7cd47d852677 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:56.944184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a979f5f-bb78-434e-8a02-7cd47d852677 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:56.944463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a979f5f-bb78-434e-8a02-7cd47d852677 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:56.944903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:56.945152 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a979f5f-bb78-434e-8a02-7cd47d852677 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:56.946635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a979f5f-bb78-434e-8a02-7cd47d852677 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:56.955636 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:56.967454 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 40/84] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:40:56 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:40:56.968245 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a979f5f-bb78-434e-8a02-7cd47d852677 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:56.971255 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a10e0-3d01-4406-8ec4-647a360cc666 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:57.010311 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc49f6-da73-4c5c-b7c3-b19266e10358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:57.010952 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc49f6-da73-4c5c-b7c3-b19266e10358 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:57.011235 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc49f6-da73-4c5c-b7c3-b19266e10358 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:57.011631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc49f6-da73-4c5c-b7c3-b19266e10358 None admin] PATH_INFO: `/v3/users/7e42be56f2284bb4ae4095ef96479453` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:57.012946 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc49f6-da73-4c5c-b7c3-b19266e10358 None admin] RBAC: Authorizing `identity:get_user(user_id=7e42be56f2284bb4ae4095ef96479453)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:57.014536 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc49f6-da73-4c5c-b7c3-b19266e10358 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:57.016310 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 45/85] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:40:56 2022] GET /identity/v3/users/7e42be56f2284bb4ae4095ef96479453 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:57.017142 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc49f6-da73-4c5c-b7c3-b19266e10358 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:57.098348 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a979f5f-bb78-434e-8a02-7cd47d852677 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:57.128570 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc49f6-da73-4c5c-b7c3-b19266e10358 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:57.136212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a0ffe-0f0f-4c80-b492-87a4329e2d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:57.137679 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0ffe-0f0f-4c80-b492-87a4329e2d5e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:57.137679 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0ffe-0f0f-4c80-b492-87a4329e2d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:57.137679 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0ffe-0f0f-4c80-b492-87a4329e2d5e None admin] PATH_INFO: `/v3/users/7e42be56f2284bb4ae4095ef96479453` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:57.138987 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a0ffe-0f0f-4c80-b492-87a4329e2d5e None admin] RBAC: Authorizing `identity:get_user(user_id=7e42be56f2284bb4ae4095ef96479453)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:57.140944 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a0ffe-0f0f-4c80-b492-87a4329e2d5e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:57.142235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 41/86] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:40:56 2022] GET /identity/v3/users/7e42be56f2284bb4ae4095ef96479453 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:57.142932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a0ffe-0f0f-4c80-b492-87a4329e2d5e None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:57.175216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c277-b683-4144-88bd-45565dd55380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:57.176120 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c277-b683-4144-88bd-45565dd55380 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:57.176404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c277-b683-4144-88bd-45565dd55380 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:57.176766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c277-b683-4144-88bd-45565dd55380 None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:57.177914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9c277-b683-4144-88bd-45565dd55380 None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:57.179375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9c277-b683-4144-88bd-45565dd55380 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:57.181045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 46/87] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:40:57 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:57.181812 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c277-b683-4144-88bd-45565dd55380 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:57.196395 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:57.229390 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:57.286231 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a0ffe-0f0f-4c80-b492-87a4329e2d5e None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:57.306765 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c277-b683-4144-88bd-45565dd55380 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:57.325903 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5bef9-ab61-48db-85a9-014c929b0eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:57.326110 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5bef9-ab61-48db-85a9-014c929b0eef None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:57.326300 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5bef9-ab61-48db-85a9-014c929b0eef None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:57.326758 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5bef9-ab61-48db-85a9-014c929b0eef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:57.350459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7165a9-15e2-4365-a89d-041a330194e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:57.351008 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7165a9-15e2-4365-a89d-041a330194e2 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:57.351294 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7165a9-15e2-4365-a89d-041a330194e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:57.351575 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7165a9-15e2-4365-a89d-041a330194e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:57.404272 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5bef9-ab61-48db-85a9-014c929b0eef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:57.405779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5bef9-ab61-48db-85a9-014c929b0eef None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:57.444641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7165a9-15e2-4365-a89d-041a330194e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:57.447268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7165a9-15e2-4365-a89d-041a330194e2 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:57.462541 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:57.471853 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:57.518853 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 42/88] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:40:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:40:57.519523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5bef9-ab61-48db-85a9-014c929b0eef None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:57.569162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 47/89] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:40:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:40:57.574826 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7165a9-15e2-4365-a89d-041a330194e2 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:57.634729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5bef9-ab61-48db-85a9-014c929b0eef None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:57.676131 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7165a9-15e2-4365-a89d-041a330194e2 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:57.677253 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fdefd-7386-425b-882c-bdda0b0daca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:57.678294 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fdefd-7386-425b-882c-bdda0b0daca0 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:57.679594 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fdefd-7386-425b-882c-bdda0b0daca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:57.680021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fdefd-7386-425b-882c-bdda0b0daca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:57.687435 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:57.716776 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:57.722898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d43ac-62b8-4761-8232-152eef9eab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:57.723657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d43ac-62b8-4761-8232-152eef9eab8a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:57.724034 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d43ac-62b8-4761-8232-152eef9eab8a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:57.724404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d43ac-62b8-4761-8232-152eef9eab8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:57.725298 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d43ac-62b8-4761-8232-152eef9eab8a None admin] RBAC: Adding query filter params (role.id=eab9c0818aa3414eb3a1a155830ad262, scope.project.id=106df7e3199d4f9896aebc029a0becf3, user.id=7e42be56f2284bb4ae4095ef96479453) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:57.725784 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d43ac-62b8-4761-8232-152eef9eab8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:57.727429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d43ac-62b8-4761-8232-152eef9eab8a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:57.740583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 48/90] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:40:57 2022] GET /identity/v3/role_assignments?user.id=7e42be56f2284bb4ae4095ef96479453&scope.project.id=106df7e3199d4f9896aebc029a0becf3&role.id=eab9c0818aa3414eb3a1a155830ad262 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:57.740583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d43ac-62b8-4761-8232-152eef9eab8a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:57.819496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fdefd-7386-425b-882c-bdda0b0daca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:57.821060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fdefd-7386-425b-882c-bdda0b0daca0 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:57.912469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d43ac-62b8-4761-8232-152eef9eab8a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:57.971577 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbca07b-b4b3-43b2-9d87-ed2e557abc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:57.972229 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbca07b-b4b3-43b2-9d87-ed2e557abc87 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:57.972514 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbca07b-b4b3-43b2-9d87-ed2e557abc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:57.972819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbca07b-b4b3-43b2-9d87-ed2e557abc87 None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:57.973976 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbca07b-b4b3-43b2-9d87-ed2e557abc87 None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:57.975448 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbca07b-b4b3-43b2-9d87-ed2e557abc87 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:57.978423 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 49/91] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:40:57 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:57.979207 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbca07b-b4b3-43b2-9d87-ed2e557abc87 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:58.011792 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 43/92] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:40:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:40:58.013123 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fdefd-7386-425b-882c-bdda0b0daca0 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:58.043953 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:58.086511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:58.134251 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fdefd-7386-425b-882c-bdda0b0daca0 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:58.180523 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbca07b-b4b3-43b2-9d87-ed2e557abc87 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:58.206667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae371552-f4ca-4394-a3ca-dbf42788171a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:58.207280 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae371552-f4ca-4394-a3ca-dbf42788171a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:58.207557 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae371552-f4ca-4394-a3ca-dbf42788171a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:58.207830 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae371552-f4ca-4394-a3ca-dbf42788171a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:58.208574 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae371552-f4ca-4394-a3ca-dbf42788171a None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=106df7e3199d4f9896aebc029a0becf3, user.id=19c04946a10143a58b50e26046837bb9) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:58.208884 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae371552-f4ca-4394-a3ca-dbf42788171a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:58.210317 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae371552-f4ca-4394-a3ca-dbf42788171a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:58.225209 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 44/93] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:40:58 2022] GET /identity/v3/role_assignments?user.id=19c04946a10143a58b50e26046837bb9&scope.project.id=106df7e3199d4f9896aebc029a0becf3&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:58.226117 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae371552-f4ca-4394-a3ca-dbf42788171a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:58.256271 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fd2de-cc60-414c-9610-b6776333bd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:58.256996 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fd2de-cc60-414c-9610-b6776333bd69 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:58.257276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fd2de-cc60-414c-9610-b6776333bd69 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:58.257552 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fd2de-cc60-414c-9610-b6776333bd69 None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:58.260028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fd2de-cc60-414c-9610-b6776333bd69 None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:58.261527 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fd2de-cc60-414c-9610-b6776333bd69 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:58.263374 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 50/94] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:40:57 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:58.274821 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fd2de-cc60-414c-9610-b6776333bd69 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:58.442996 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae371552-f4ca-4394-a3ca-dbf42788171a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:58.485720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:58.487093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fd2de-cc60-414c-9610-b6776333bd69 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:58.506541 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:58.508919 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca250991-5918-4353-9cb9-a4823c7346d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:58.509773 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250991-5918-4353-9cb9-a4823c7346d4 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:58.509880 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250991-5918-4353-9cb9-a4823c7346d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:58.510108 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250991-5918-4353-9cb9-a4823c7346d4 None admin] PATH_INFO: `/v3/projects/25114217f4e74d8bbd75b0a3a1f6f105` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:58.512891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca250991-5918-4353-9cb9-a4823c7346d4 None admin] RBAC: Authorizing `identity:get_project(project_id=25114217f4e74d8bbd75b0a3a1f6f105)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:58.514460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca250991-5918-4353-9cb9-a4823c7346d4 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:58.518272 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 45/95] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:40:58 2022] GET /identity/v3/projects/25114217f4e74d8bbd75b0a3a1f6f105 => generated 312 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:58.523925 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca250991-5918-4353-9cb9-a4823c7346d4 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:40:58.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0393f-2f3b-4c9b-995a-7c2801b6499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:58.559783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0393f-2f3b-4c9b-995a-7c2801b6499b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:58.560067 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0393f-2f3b-4c9b-995a-7c2801b6499b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:58.560341 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0393f-2f3b-4c9b-995a-7c2801b6499b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:58.563716 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0393f-2f3b-4c9b-995a-7c2801b6499b None admin] RBAC: Adding query filter params (role.id=3ebdb28c195f447294810f1033bb8e62, scope.project.id=106df7e3199d4f9896aebc029a0becf3, user.id=7e42be56f2284bb4ae4095ef96479453) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:58.564037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0393f-2f3b-4c9b-995a-7c2801b6499b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:58.565564 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0393f-2f3b-4c9b-995a-7c2801b6499b None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:58.575493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 51/96] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:40:58 2022] GET /identity/v3/role_assignments?user.id=7e42be56f2284bb4ae4095ef96479453&scope.project.id=106df7e3199d4f9896aebc029a0becf3&role.id=3ebdb28c195f447294810f1033bb8e62 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:40:58.690554 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca250991-5918-4353-9cb9-a4823c7346d4 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:40:58.728363 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009fcb9-c1ab-4a93-b267-9a319acb13ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:40:58.728940 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009fcb9-c1ab-4a93-b267-9a319acb13ca None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:58.729225 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009fcb9-c1ab-4a93-b267-9a319acb13ca None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:58.729505 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009fcb9-c1ab-4a93-b267-9a319acb13ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:58.730260 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009fcb9-c1ab-4a93-b267-9a319acb13ca None admin] RBAC: Adding query filter params (role.id=eab9c0818aa3414eb3a1a155830ad262, scope.project.id=25114217f4e74d8bbd75b0a3a1f6f105, user.id=7e42be56f2284bb4ae4095ef96479453) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:40:58.730578 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009fcb9-c1ab-4a93-b267-9a319acb13ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:40:58.732060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009fcb9-c1ab-4a93-b267-9a319acb13ca None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:40:58.742762 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 46/97] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:40:58 2022] GET /identity/v3/role_assignments?user.id=7e42be56f2284bb4ae4095ef96479453&scope.project.id=25114217f4e74d8bbd75b0a3a1f6f105&role.id=eab9c0818aa3414eb3a1a155830ad262 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:40:59.522365 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68cdf-8d9f-4b86-ada8-a5ca290eec61 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:59.522908 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68cdf-8d9f-4b86-ada8-a5ca290eec61 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:59.522908 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68cdf-8d9f-4b86-ada8-a5ca290eec61 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:59.524389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 52/98] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:40:59.529955 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dcde1-5173-4903-93bc-a4ff49a256a1 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:40:59.530350 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dcde1-5173-4903-93bc-a4ff49a256a1 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:40:59.530572 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dcde1-5173-4903-93bc-a4ff49a256a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:40:59.561647 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-ef0dcde1-5173-4903-93bc-a4ff49a256a1 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:40:59.562915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-ef0dcde1-5173-4903-93bc-a4ff49a256a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:40:59.621280 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:40:59.639735 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 47/99] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:00.100782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e22390-9e27-450e-a0cc-e05b766392f6 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:00.101112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e22390-9e27-450e-a0cc-e05b766392f6 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:00.101286 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e22390-9e27-450e-a0cc-e05b766392f6 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:00.102741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 53/100] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:00.120041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62086f04-a02a-44f3-9b9e-b7a5df63c1a9 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:00.120334 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62086f04-a02a-44f3-9b9e-b7a5df63c1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:00.120645 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62086f04-a02a-44f3-9b9e-b7a5df63c1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:00.143674 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-62086f04-a02a-44f3-9b9e-b7a5df63c1a9 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:00.144889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-62086f04-a02a-44f3-9b9e-b7a5df63c1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:00.165495 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e22390-9e27-450e-a0cc-e05b766392f6 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:00.283917 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 48/101] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:00.350240 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e22390-9e27-450e-a0cc-e05b766392f6 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:00.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf98f39-d8e0-40f5-911b-059c879ef866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:00.399747 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf98f39-d8e0-40f5-911b-059c879ef866 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:00.400026 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf98f39-d8e0-40f5-911b-059c879ef866 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:00.400300 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf98f39-d8e0-40f5-911b-059c879ef866 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:00.414512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf98f39-d8e0-40f5-911b-059c879ef866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-adf98f39-d8e0-40f5-911b-059c879ef866 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:00.419918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:00.420757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:00.421487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:00.421487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:00.421487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:00.421487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:00.421487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:00.421487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:00.421487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:00.421487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:00.421487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:00.421487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:00.421487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:00.421487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:00.421487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 54/102] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:41:00.427578 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62086f04-a02a-44f3-9b9e-b7a5df63c1a9 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:00.553617 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62086f04-a02a-44f3-9b9e-b7a5df63c1a9 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:00.576089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:00.608508 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338ba20-ee71-46cd-bb1f-abb7f7f37814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:00.609148 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338ba20-ee71-46cd-bb1f-abb7f7f37814 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:00.609431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338ba20-ee71-46cd-bb1f-abb7f7f37814 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:00.610238 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338ba20-ee71-46cd-bb1f-abb7f7f37814 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:00.610916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338ba20-ee71-46cd-bb1f-abb7f7f37814 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:00.611226 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338ba20-ee71-46cd-bb1f-abb7f7f37814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:00.612629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338ba20-ee71-46cd-bb1f-abb7f7f37814 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:00.628676 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 49/103] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:00.634573 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf98f39-d8e0-40f5-911b-059c879ef866 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:00.694470 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338ba20-ee71-46cd-bb1f-abb7f7f37814 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:00.715446 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:00.809159 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338ba20-ee71-46cd-bb1f-abb7f7f37814 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:00.847524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45717752-45a2-43c2-bad1-9e70423c4d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:00.848476 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45717752-45a2-43c2-bad1-9e70423c4d00 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:00.849016 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45717752-45a2-43c2-bad1-9e70423c4d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:00.849730 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45717752-45a2-43c2-bad1-9e70423c4d00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:00.854325 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45717752-45a2-43c2-bad1-9e70423c4d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:00.861940 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45717752-45a2-43c2-bad1-9e70423c4d00 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:00.863851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 50/104] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:00.869433 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459bab-3bee-4e1a-80a4-206939b5a473 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:00.869960 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459bab-3bee-4e1a-80a4-206939b5a473 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:00.870562 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459bab-3bee-4e1a-80a4-206939b5a473 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:00.873166 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 51/105] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:00.878461 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d9ed5-ad98-4747-926e-e096dda2e778 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:00.878957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d9ed5-ad98-4747-926e-e096dda2e778 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:00.879426 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d9ed5-ad98-4747-926e-e096dda2e778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:00.897551 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf98f39-d8e0-40f5-911b-059c879ef866 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:00.915463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-f48d9ed5-ad98-4747-926e-e096dda2e778 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:00.917127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-f48d9ed5-ad98-4747-926e-e096dda2e778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:00.961524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:00.962650 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187314b-abc1-4676-8367-33d8c2c3d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:00.963476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187314b-abc1-4676-8367-33d8c2c3d1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:00.963765 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187314b-abc1-4676-8367-33d8c2c3d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:00.964256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187314b-abc1-4676-8367-33d8c2c3d1f6 None admin] PATH_INFO: `/v3/users/60461a36887841f189cf9a058f0ea39a` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:00.994076 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187314b-abc1-4676-8367-33d8c2c3d1f6 None admin] RBAC: Authorizing `identity:get_user(user_id=60461a36887841f189cf9a058f0ea39a)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:00.997003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187314b-abc1-4676-8367-33d8c2c3d1f6 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:00.999467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 52/106] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:01.001141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d9ed5-ad98-4747-926e-e096dda2e778 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:01.001586 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 55/107] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:00 2022] GET /identity/v3/users/60461a36887841f189cf9a058f0ea39a => generated 289 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:01.010052 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187314b-abc1-4676-8367-33d8c2c3d1f6 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:01.161568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:01.174496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187314b-abc1-4676-8367-33d8c2c3d1f6 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:01.231895 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a526e29-8771-488d-aaaa-1e407d457107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:01.232957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a526e29-8771-488d-aaaa-1e407d457107 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:01.233532 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a526e29-8771-488d-aaaa-1e407d457107 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:01.234004 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a526e29-8771-488d-aaaa-1e407d457107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:01.262894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d9ed5-ad98-4747-926e-e096dda2e778 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:01.334446 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976ccc1-901d-4d0e-9cda-2281c71437d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:01.335498 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976ccc1-901d-4d0e-9cda-2281c71437d0 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:01.335970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976ccc1-901d-4d0e-9cda-2281c71437d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:01.336437 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976ccc1-901d-4d0e-9cda-2281c71437d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:01.337311 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976ccc1-901d-4d0e-9cda-2281c71437d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:01.339068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976ccc1-901d-4d0e-9cda-2281c71437d0 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:01.389893 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 53/108] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Sep 25 00:41:00 2022] POST /identity/v3/projects => generated 302 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:41:01.407652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a526e29-8771-488d-aaaa-1e407d457107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:01.413265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a526e29-8771-488d-aaaa-1e407d457107 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:01.505390 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976ccc1-901d-4d0e-9cda-2281c71437d0 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:01.575970 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:01.578332 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:01.587354 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 56/109] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:41:01.593336 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a526e29-8771-488d-aaaa-1e407d457107 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:01.727482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976ccc1-901d-4d0e-9cda-2281c71437d0 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:01.772201 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a526e29-8771-488d-aaaa-1e407d457107 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:01.804434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d14a-2a14-497a-8d3c-da4771cbe6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:01.805617 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d14a-2a14-497a-8d3c-da4771cbe6df None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:01.806120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d14a-2a14-497a-8d3c-da4771cbe6df None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:01.806579 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d14a-2a14-497a-8d3c-da4771cbe6df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:01.825440 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8d14a-2a14-497a-8d3c-da4771cbe6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:01.828993 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a2f36-6afa-45bc-8fce-f59a76163ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:01.830196 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2f36-6afa-45bc-8fce-f59a76163ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:01.830564 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2f36-6afa-45bc-8fce-f59a76163ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:01.830911 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2f36-6afa-45bc-8fce-f59a76163ac8 None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:01.832245 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a2f36-6afa-45bc-8fce-f59a76163ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-e3c8d14a-2a14-497a-8d3c-da4771cbe6df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:01.833610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:01.834416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:01.835157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:01.835157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:01.835157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:01.835157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:01.835157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:01.835157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:01.835157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:01.835157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:01.835157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:01.835157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:01.835157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:01.835157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:01.835742 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a2f36-6afa-45bc-8fce-f59a76163ac8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:01.836765 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 57/110] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:01 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:01.837468 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 54/111] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:01.838208 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45564-f6da-40f2-a266-fa481f3fb64b None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:01.838565 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45564-f6da-40f2-a266-fa481f3fb64b None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:01.838914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45564-f6da-40f2-a266-fa481f3fb64b None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:01.844586 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 58/112] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:01.844728 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d14a-2a14-497a-8d3c-da4771cbe6df None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:01.846811 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa45564-f6da-40f2-a266-fa481f3fb64b None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:01.932803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:01.950136 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:01.967573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d14a-2a14-497a-8d3c-da4771cbe6df None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:01.988783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa45564-f6da-40f2-a266-fa481f3fb64b None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:02.011034 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947efab-394a-469f-b170-9717ba19352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:02.012023 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947efab-394a-469f-b170-9717ba19352f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:02.012792 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947efab-394a-469f-b170-9717ba19352f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:02.014020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947efab-394a-469f-b170-9717ba19352f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:02.016477 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947efab-394a-469f-b170-9717ba19352f None admin] RBAC: Adding query filter params (role.id=8fcc3c7d309e469fad57a0bb086976fd, scope.project.id=106df7e3199d4f9896aebc029a0becf3, user.id=60461a36887841f189cf9a058f0ea39a) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:02.016990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947efab-394a-469f-b170-9717ba19352f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:02.018672 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947efab-394a-469f-b170-9717ba19352f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:02.026377 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 55/113] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:01 2022] GET /identity/v3/role_assignments?user.id=60461a36887841f189cf9a058f0ea39a&scope.project.id=106df7e3199d4f9896aebc029a0becf3&role.id=8fcc3c7d309e469fad57a0bb086976fd => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:02.028275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace7ca6-ff4e-4231-9e97-66a7f775e363 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:02.028988 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace7ca6-ff4e-4231-9e97-66a7f775e363 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:02.029650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace7ca6-ff4e-4231-9e97-66a7f775e363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:02.030753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654be7b8-7f49-4010-bfd1-c0698ed76fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:02.032053 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654be7b8-7f49-4010-bfd1-c0698ed76fde None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:02.032338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654be7b8-7f49-4010-bfd1-c0698ed76fde None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:02.032640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654be7b8-7f49-4010-bfd1-c0698ed76fde None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:02.033328 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654be7b8-7f49-4010-bfd1-c0698ed76fde None admin] RBAC: Adding query filter params (name=member) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:02.033699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654be7b8-7f49-4010-bfd1-c0698ed76fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:02.035111 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654be7b8-7f49-4010-bfd1-c0698ed76fde None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:02.046437 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 59/114] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:02.047858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbae6f6-4796-4dc0-8ede-6be95fb1c96c None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:02.048148 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbae6f6-4796-4dc0-8ede-6be95fb1c96c None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:02.048429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbae6f6-4796-4dc0-8ede-6be95fb1c96c None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:02.050600 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 60/115] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:02.055559 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbae6f6-4796-4dc0-8ede-6be95fb1c96c None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:02.058079 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-6ace7ca6-ff4e-4231-9e97-66a7f775e363 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:02.059809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-6ace7ca6-ff4e-4231-9e97-66a7f775e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:02.150067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 56/116] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:02.152139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8d1a3-4c6a-4f64-b208-4046eb96ca08 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:02.152956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8d1a3-4c6a-4f64-b208-4046eb96ca08 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:02.153587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8d1a3-4c6a-4f64-b208-4046eb96ca08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:02.175070 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-91c8d1a3-4c6a-4f64-b208-4046eb96ca08 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:02.176866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-91c8d1a3-4c6a-4f64-b208-4046eb96ca08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:02.177903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbae6f6-4796-4dc0-8ede-6be95fb1c96c None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:02.203114 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:02.217153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9189d-716c-47f0-8f9b-321b0251d0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:02.217909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9189d-716c-47f0-8f9b-321b0251d0fb None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:02.218270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9189d-716c-47f0-8f9b-321b0251d0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:02.218697 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9189d-716c-47f0-8f9b-321b0251d0fb None admin] PATH_INFO: `/v3/users/7e42be56f2284bb4ae4095ef96479453` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:02.220535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9189d-716c-47f0-8f9b-321b0251d0fb None admin] RBAC: Authorizing `identity:get_user(user_id=7e42be56f2284bb4ae4095ef96479453)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:02.222263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9189d-716c-47f0-8f9b-321b0251d0fb None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:02.224286 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 61/117] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:02 2022] GET /identity/v3/users/7e42be56f2284bb4ae4095ef96479453 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:02.229876 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9189d-716c-47f0-8f9b-321b0251d0fb None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:02.263530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 57/118] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:02.278407 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde43000-4b49-49a9-8734-6ebb96e639dd None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:02.279059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde43000-4b49-49a9-8734-6ebb96e639dd None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:02.279543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde43000-4b49-49a9-8734-6ebb96e639dd None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:02.281224 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 58/119] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:41:02.287881 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a8f3d-2ae7-4720-8a01-fd507c7d3b4a None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:02.288481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a8f3d-2ae7-4720-8a01-fd507c7d3b4a None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:02.288995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a8f3d-2ae7-4720-8a01-fd507c7d3b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:02.311527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-565a8f3d-2ae7-4720-8a01-fd507c7d3b4a None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:02.313634 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-565a8f3d-2ae7-4720-8a01-fd507c7d3b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:02.322433 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:02.392225 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 59/120] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:02.418509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9189d-716c-47f0-8f9b-321b0251d0fb None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:02.469800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c2b1b-c8c6-46b0-8108-f879c2162e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:02.470437 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c2b1b-c8c6-46b0-8108-f879c2162e9a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:02.470721 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c2b1b-c8c6-46b0-8108-f879c2162e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:02.470998 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c2b1b-c8c6-46b0-8108-f879c2162e9a None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:02.472334 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c2b1b-c8c6-46b0-8108-f879c2162e9a None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:02.474050 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c2b1b-c8c6-46b0-8108-f879c2162e9a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:02.476143 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 62/121] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:02 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:02.482255 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a8f3d-2ae7-4720-8a01-fd507c7d3b4a None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:02.616249 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a8f3d-2ae7-4720-8a01-fd507c7d3b4a None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:02.635280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c2b1b-c8c6-46b0-8108-f879c2162e9a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:02.654054 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396667b5-e918-4af5-a8b2-f0a1906595f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:02.655039 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396667b5-e918-4af5-a8b2-f0a1906595f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:02.655545 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396667b5-e918-4af5-a8b2-f0a1906595f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:02.656019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396667b5-e918-4af5-a8b2-f0a1906595f0 None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3/users/7e42be56f2284bb4ae4095ef96479453/roles/eab9c0818aa3414eb3a1a155830ad262` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:02.658342 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396667b5-e918-4af5-a8b2-f0a1906595f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=106df7e3199d4f9896aebc029a0becf3, user_id=7e42be56f2284bb4ae4095ef96479453, role_id=eab9c0818aa3414eb3a1a155830ad262)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:02.659992 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396667b5-e918-4af5-a8b2-f0a1906595f0 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:02.684359 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 60/122] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:41:02 2022] PUT /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3/users/7e42be56f2284bb4ae4095ef96479453/roles/eab9c0818aa3414eb3a1a155830ad262 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:41:02.697021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396667b5-e918-4af5-a8b2-f0a1906595f0 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:02.700721 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:02.758534 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:02.831213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c2b1b-c8c6-46b0-8108-f879c2162e9a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:02.864033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396667b5-e918-4af5-a8b2-f0a1906595f0 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:02.917825 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81084c41-0e2a-4a56-b8c4-624ae30a21a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:02.918483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81084c41-0e2a-4a56-b8c4-624ae30a21a8 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:02.918764 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81084c41-0e2a-4a56-b8c4-624ae30a21a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:02.919043 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81084c41-0e2a-4a56-b8c4-624ae30a21a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:02.934744 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dbfd2-f47a-4a29-90cf-3fb36dc87b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:02.935402 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dbfd2-f47a-4a29-90cf-3fb36dc87b27 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:02.935685 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dbfd2-f47a-4a29-90cf-3fb36dc87b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:02.935965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dbfd2-f47a-4a29-90cf-3fb36dc87b27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:02.948643 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81084c41-0e2a-4a56-b8c4-624ae30a21a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-81084c41-0e2a-4a56-b8c4-624ae30a21a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:02.955640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:02.956528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:02.957320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:02.957320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:02.957320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:02.957320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:02.957320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:02.957320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:02.957320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:02.957320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:02.957320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:02.957320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:02.957320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:02.957320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:02.961363 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dbfd2-f47a-4a29-90cf-3fb36dc87b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:02.966148 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 63/123] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:41:02.966991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81084c41-0e2a-4a56-b8c4-624ae30a21a8 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-463dbfd2-f47a-4a29-90cf-3fb36dc87b27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:02.967183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:02.969452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:02.971362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:02.971362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:02.971362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:02.971362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:02.971362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:02.971362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:02.971362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:02.971362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:02.971362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:02.971362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:02.971362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:02.971362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:02.971362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 61/124] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:41:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:02.977740 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dbfd2-f47a-4a29-90cf-3fb36dc87b27 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:03.048018 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:03.091944 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dbfd2-f47a-4a29-90cf-3fb36dc87b27 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:03.094945 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81084c41-0e2a-4a56-b8c4-624ae30a21a8 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:03.113993 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:03.131600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6fc18-62a7-4a04-ba6a-c3adb45137bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:03.132223 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6fc18-62a7-4a04-ba6a-c3adb45137bb None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:03.132506 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6fc18-62a7-4a04-ba6a-c3adb45137bb None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:03.132832 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6fc18-62a7-4a04-ba6a-c3adb45137bb None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:03.133523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6fc18-62a7-4a04-ba6a-c3adb45137bb None admin] RBAC: Adding query filter params (name=member) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:03.133814 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6fc18-62a7-4a04-ba6a-c3adb45137bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:03.135140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe101930-7def-4c18-84b8-5eeac19521ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:03.135266 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6fc18-62a7-4a04-ba6a-c3adb45137bb None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:03.136093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe101930-7def-4c18-84b8-5eeac19521ca None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:03.136602 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe101930-7def-4c18-84b8-5eeac19521ca None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:03.137085 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe101930-7def-4c18-84b8-5eeac19521ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:03.144591 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 62/125] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:03.148870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe101930-7def-4c18-84b8-5eeac19521ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:03.149323 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6fc18-62a7-4a04-ba6a-c3adb45137bb None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-fe101930-7def-4c18-84b8-5eeac19521ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:03.155226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:03.156051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:03.157384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:03.157384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:03.157384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:03.157384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:03.157384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:03.157384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:03.157384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:03.157384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:03.157384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:03.157384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:03.157384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:03.157384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:03.159620 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 64/126] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:41:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:03.160614 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe101930-7def-4c18-84b8-5eeac19521ca None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:03.343740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe101930-7def-4c18-84b8-5eeac19521ca None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:03.373193 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6fc18-62a7-4a04-ba6a-c3adb45137bb None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:03.387782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884599f2-5077-4c45-b7cf-dbd8316f7639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:03.388734 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884599f2-5077-4c45-b7cf-dbd8316f7639 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:03.389245 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884599f2-5077-4c45-b7cf-dbd8316f7639 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:03.389751 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884599f2-5077-4c45-b7cf-dbd8316f7639 None admin] PATH_INFO: `/v3/users/7e42be56f2284bb4ae4095ef96479453` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:03.393993 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884599f2-5077-4c45-b7cf-dbd8316f7639 None admin] RBAC: Authorizing `identity:get_user(user_id=7e42be56f2284bb4ae4095ef96479453)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:03.395487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884599f2-5077-4c45-b7cf-dbd8316f7639 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:03.397140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 65/127] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:03 2022] GET /identity/v3/users/7e42be56f2284bb4ae4095ef96479453 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:03.397912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884599f2-5077-4c45-b7cf-dbd8316f7639 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:03.440915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:03.460288 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a085b50-a3dc-4dff-98e2-666567a12618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:03.461656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a085b50-a3dc-4dff-98e2-666567a12618 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:03.462421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a085b50-a3dc-4dff-98e2-666567a12618 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:03.463127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a085b50-a3dc-4dff-98e2-666567a12618 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:03.464537 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a085b50-a3dc-4dff-98e2-666567a12618 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:03.470892 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a085b50-a3dc-4dff-98e2-666567a12618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:03.472524 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:03.473462 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a085b50-a3dc-4dff-98e2-666567a12618 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:03.498241 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 63/128] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:03.499159 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a085b50-a3dc-4dff-98e2-666567a12618 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:03.535297 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884599f2-5077-4c45-b7cf-dbd8316f7639 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:03.581040 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20b244-b4c2-4119-921c-9e6438c079b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:03.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20b244-b4c2-4119-921c-9e6438c079b4 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:03.581967 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20b244-b4c2-4119-921c-9e6438c079b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:03.582241 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20b244-b4c2-4119-921c-9e6438c079b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:03.582935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20b244-b4c2-4119-921c-9e6438c079b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:03.583245 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20b244-b4c2-4119-921c-9e6438c079b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:03.592767 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20b244-b4c2-4119-921c-9e6438c079b4 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:03.618528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 66/129] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:03.619397 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20b244-b4c2-4119-921c-9e6438c079b4 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:03.647319 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a085b50-a3dc-4dff-98e2-666567a12618 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:03.694741 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7ab8b-2a07-47e7-961f-e1110febf35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:03.695714 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ab8b-2a07-47e7-961f-e1110febf35e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:03.697285 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ab8b-2a07-47e7-961f-e1110febf35e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:03.699211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ab8b-2a07-47e7-961f-e1110febf35e None admin] PATH_INFO: `/v3/projects/25114217f4e74d8bbd75b0a3a1f6f105` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:03.701914 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7ab8b-2a07-47e7-961f-e1110febf35e None admin] RBAC: Authorizing `identity:get_project(project_id=25114217f4e74d8bbd75b0a3a1f6f105)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:03.706056 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7ab8b-2a07-47e7-961f-e1110febf35e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:03.714693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 64/130] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:03 2022] GET /identity/v3/projects/25114217f4e74d8bbd75b0a3a1f6f105 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:03.715658 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7ab8b-2a07-47e7-961f-e1110febf35e None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:03.789312 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20b244-b4c2-4119-921c-9e6438c079b4 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:03.799943 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:03.832294 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc3ca9-6b53-4be1-90c7-abbcb63fd72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:03.833269 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc3ca9-6b53-4be1-90c7-abbcb63fd72f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:03.833622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc3ca9-6b53-4be1-90c7-abbcb63fd72f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:03.833968 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc3ca9-6b53-4be1-90c7-abbcb63fd72f None admin] PATH_INFO: `/v3/users/7e42be56f2284bb4ae4095ef96479453` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:03.835289 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc3ca9-6b53-4be1-90c7-abbcb63fd72f None admin] RBAC: Authorizing `identity:get_user(user_id=7e42be56f2284bb4ae4095ef96479453)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:03.837774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc3ca9-6b53-4be1-90c7-abbcb63fd72f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:03.839388 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 67/131] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:03 2022] GET /identity/v3/users/7e42be56f2284bb4ae4095ef96479453 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:03.840144 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc3ca9-6b53-4be1-90c7-abbcb63fd72f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:03.894495 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:03.957822 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7ab8b-2a07-47e7-961f-e1110febf35e None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:03.989826 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc3ca9-6b53-4be1-90c7-abbcb63fd72f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:04.012506 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fee561-0a00-484d-9fb4-a6b1db8d519c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:04.013245 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fee561-0a00-484d-9fb4-a6b1db8d519c None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:04.013530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fee561-0a00-484d-9fb4-a6b1db8d519c None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:04.013807 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fee561-0a00-484d-9fb4-a6b1db8d519c None admin] PATH_INFO: `/v3/users/19c04946a10143a58b50e26046837bb9` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:04.015880 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fee561-0a00-484d-9fb4-a6b1db8d519c None admin] RBAC: Authorizing `identity:get_user(user_id=19c04946a10143a58b50e26046837bb9)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:04.017374 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fee561-0a00-484d-9fb4-a6b1db8d519c None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:04.019144 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 65/132] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:03 2022] GET /identity/v3/users/19c04946a10143a58b50e26046837bb9 => generated 247 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:04.019747 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fee561-0a00-484d-9fb4-a6b1db8d519c None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:04.054088 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a018e2-e673-4604-a7ac-acc880efa3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:04.054768 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a018e2-e673-4604-a7ac-acc880efa3d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:04.055051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a018e2-e673-4604-a7ac-acc880efa3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:04.055332 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a018e2-e673-4604-a7ac-acc880efa3d1 None admin] PATH_INFO: `/v3/projects/25114217f4e74d8bbd75b0a3a1f6f105/users/7e42be56f2284bb4ae4095ef96479453/roles/eab9c0818aa3414eb3a1a155830ad262` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:04.065379 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a018e2-e673-4604-a7ac-acc880efa3d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=25114217f4e74d8bbd75b0a3a1f6f105, user_id=7e42be56f2284bb4ae4095ef96479453, role_id=eab9c0818aa3414eb3a1a155830ad262)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:04.066882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a018e2-e673-4604-a7ac-acc880efa3d1 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:04.107077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 68/133] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:41:03 2022] PUT /identity/v3/projects/25114217f4e74d8bbd75b0a3a1f6f105/users/7e42be56f2284bb4ae4095ef96479453/roles/eab9c0818aa3414eb3a1a155830ad262 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:41:04.108055 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a018e2-e673-4604-a7ac-acc880efa3d1 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:04.152058 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fee561-0a00-484d-9fb4-a6b1db8d519c None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:04.196211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:04.201695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:04.203805 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e775f-ae94-4870-8adc-3b2f24600a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:04.204502 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e775f-ae94-4870-8adc-3b2f24600a0c None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:04.204821 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e775f-ae94-4870-8adc-3b2f24600a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:04.205113 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e775f-ae94-4870-8adc-3b2f24600a0c None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:04.206282 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e775f-ae94-4870-8adc-3b2f24600a0c None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:04.207833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e775f-ae94-4870-8adc-3b2f24600a0c None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:04.209937 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 66/134] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:04 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:04.215771 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e775f-ae94-4870-8adc-3b2f24600a0c None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:04.326644 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e775f-ae94-4870-8adc-3b2f24600a0c None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:04.362234 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e27b6-1d57-43bf-aa31-1c9a1f858a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:04.362916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e27b6-1d57-43bf-aa31-1c9a1f858a9e None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:04.363201 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e27b6-1d57-43bf-aa31-1c9a1f858a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:04.363480 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e27b6-1d57-43bf-aa31-1c9a1f858a9e None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3/users/7e42be56f2284bb4ae4095ef96479453/roles/3ebdb28c195f447294810f1033bb8e62` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:04.365766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e27b6-1d57-43bf-aa31-1c9a1f858a9e None admin] RBAC: Authorizing `identity:create_grant(project_id=106df7e3199d4f9896aebc029a0becf3, user_id=7e42be56f2284bb4ae4095ef96479453, role_id=3ebdb28c195f447294810f1033bb8e62)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:04.367242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e27b6-1d57-43bf-aa31-1c9a1f858a9e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:04.379764 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a018e2-e673-4604-a7ac-acc880efa3d1 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:04.383882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 67/135] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:41:04 2022] PUT /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3/users/7e42be56f2284bb4ae4095ef96479453/roles/3ebdb28c195f447294810f1033bb8e62 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:41:04.451532 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c5114-a693-46f1-be13-06e49a22910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:04.452120 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c5114-a693-46f1-be13-06e49a22910b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:04.452407 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c5114-a693-46f1-be13-06e49a22910b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:04.452723 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c5114-a693-46f1-be13-06e49a22910b None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:04.457563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c5114-a693-46f1-be13-06e49a22910b None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:04.459113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c5114-a693-46f1-be13-06e49a22910b None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:04.461358 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 69/136] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:04 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:04.467416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e27b6-1d57-43bf-aa31-1c9a1f858a9e None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:04.480850 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b8dbc-03b7-4d93-9d55-cd770d871a88 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:04.481166 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b8dbc-03b7-4d93-9d55-cd770d871a88 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:04.481425 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b8dbc-03b7-4d93-9d55-cd770d871a88 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:04.482810 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 70/137] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:04.488867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b870d3-3bc4-4503-ae7a-86d32823edcd None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:04.489157 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b870d3-3bc4-4503-ae7a-86d32823edcd None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:04.489447 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b870d3-3bc4-4503-ae7a-86d32823edcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:04.510276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-b0b870d3-3bc4-4503-ae7a-86d32823edcd None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:04.514278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-b0b870d3-3bc4-4503-ae7a-86d32823edcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:04.549583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:04.598049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 71/138] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:04.611398 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e27b6-1d57-43bf-aa31-1c9a1f858a9e None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:04.647647 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491210b7-6662-4a2a-91c1-9e810d75d760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:04.648390 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491210b7-6662-4a2a-91c1-9e810d75d760 None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:04.648635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491210b7-6662-4a2a-91c1-9e810d75d760 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:04.648922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491210b7-6662-4a2a-91c1-9e810d75d760 None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3/users/19c04946a10143a58b50e26046837bb9/roles/a6d585feb70946b1b1ebcaece17d26b2` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:04.650869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491210b7-6662-4a2a-91c1-9e810d75d760 None admin] RBAC: Authorizing `identity:create_grant(project_id=106df7e3199d4f9896aebc029a0becf3, user_id=19c04946a10143a58b50e26046837bb9, role_id=a6d585feb70946b1b1ebcaece17d26b2)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:04.652361 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491210b7-6662-4a2a-91c1-9e810d75d760 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:04.668086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 68/139] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:41:04 2022] PUT /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3/users/19c04946a10143a58b50e26046837bb9/roles/a6d585feb70946b1b1ebcaece17d26b2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:41:04.993814 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883a1ab-57d4-403d-9c98-52cdbf873d47 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:04.994306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883a1ab-57d4-403d-9c98-52cdbf873d47 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:04.994404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883a1ab-57d4-403d-9c98-52cdbf873d47 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:04.995927 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 72/140] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:05.013771 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcffbb4-8160-46b8-a630-e1b08ca99bff None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:05.014132 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcffbb4-8160-46b8-a630-e1b08ca99bff None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:05.014338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcffbb4-8160-46b8-a630-e1b08ca99bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:05.037559 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-edcffbb4-8160-46b8-a630-e1b08ca99bff None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:05.038763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-edcffbb4-8160-46b8-a630-e1b08ca99bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:05.047700 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883a1ab-57d4-403d-9c98-52cdbf873d47 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:05.135551 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 69/141] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:05.148917 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:05.269278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883a1ab-57d4-403d-9c98-52cdbf873d47 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:05.314253 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f8580-736d-4fc1-80d5-812aeda95714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:05.314898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f8580-736d-4fc1-80d5-812aeda95714 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:05.315183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f8580-736d-4fc1-80d5-812aeda95714 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:05.315464 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f8580-736d-4fc1-80d5-812aeda95714 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:05.316633 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f8580-736d-4fc1-80d5-812aeda95714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:05.318136 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f8580-736d-4fc1-80d5-812aeda95714 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:05.319773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 73/142] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:05.325791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcffbb4-8160-46b8-a630-e1b08ca99bff None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:05.383759 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:05.453473 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcffbb4-8160-46b8-a630-e1b08ca99bff None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:05.488916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf08999-6b7f-4684-bf9c-560e8c2093d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:05.489539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf08999-6b7f-4684-bf9c-560e8c2093d7 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:05.489824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf08999-6b7f-4684-bf9c-560e8c2093d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:05.490107 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf08999-6b7f-4684-bf9c-560e8c2093d7 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:05.490838 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf08999-6b7f-4684-bf9c-560e8c2093d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:05.492296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf08999-6b7f-4684-bf9c-560e8c2093d7 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:05.518580 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 70/143] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:41:05 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:41:05.645701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f8580-736d-4fc1-80d5-812aeda95714 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:05.795634 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f8580-736d-4fc1-80d5-812aeda95714 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:05.797480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:05.835245 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b92f3-1250-445d-be18-b994152194ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:05.835896 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b92f3-1250-445d-be18-b994152194ec None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:05.836180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b92f3-1250-445d-be18-b994152194ec None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:05.836456 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b92f3-1250-445d-be18-b994152194ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:05.847774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b92f3-1250-445d-be18-b994152194ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-c52b92f3-1250-445d-be18-b994152194ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:05.852689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:05.853548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:05.854343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:05.854343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:05.854343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:05.854343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:05.854343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:05.854343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:05.854343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:05.854343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:05.854343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:05.854343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:05.854343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:05.854343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:05.854343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 74/144] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:05.859982 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf08999-6b7f-4684-bf9c-560e8c2093d7 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:05.944982 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb4007-3610-4723-85e7-e620fecc20ae None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:05.945427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb4007-3610-4723-85e7-e620fecc20ae None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:05.945855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb4007-3610-4723-85e7-e620fecc20ae None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:05.947627 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 75/145] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:05.952634 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84181375-1f6c-47c9-b6aa-0c155347195e None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:05.952925 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84181375-1f6c-47c9-b6aa-0c155347195e None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:05.953745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84181375-1f6c-47c9-b6aa-0c155347195e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:05.978873 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-84181375-1f6c-47c9-b6aa-0c155347195e None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:05.980091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-84181375-1f6c-47c9-b6aa-0c155347195e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:05.988761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:06.002485 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf08999-6b7f-4684-bf9c-560e8c2093d7 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:06.071843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53696a4-38e0-4c68-b322-f3dcb2465a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:06.072940 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53696a4-38e0-4c68-b322-f3dcb2465a5a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:06.073490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53696a4-38e0-4c68-b322-f3dcb2465a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:06.073766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53696a4-38e0-4c68-b322-f3dcb2465a5a None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:06.074442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53696a4-38e0-4c68-b322-f3dcb2465a5a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:06.074746 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53696a4-38e0-4c68-b322-f3dcb2465a5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:06.076124 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53696a4-38e0-4c68-b322-f3dcb2465a5a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:06.086359 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 71/146] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:06.092027 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 76/147] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:06.092510 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53696a4-38e0-4c68-b322-f3dcb2465a5a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:06.200299 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53696a4-38e0-4c68-b322-f3dcb2465a5a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:06.236233 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5f4f0-e8c5-407b-9562-1caa343b844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:06.237223 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5f4f0-e8c5-407b-9562-1caa343b844f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:06.237745 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5f4f0-e8c5-407b-9562-1caa343b844f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:06.238220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5f4f0-e8c5-407b-9562-1caa343b844f None admin] PATH_INFO: `/v3/users/60461a36887841f189cf9a058f0ea39a` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:06.239587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5f4f0-e8c5-407b-9562-1caa343b844f None admin] RBAC: Authorizing `identity:get_user(user_id=60461a36887841f189cf9a058f0ea39a)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:06.241281 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5f4f0-e8c5-407b-9562-1caa343b844f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:06.243069 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 72/148] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:06 2022] GET /identity/v3/users/60461a36887841f189cf9a058f0ea39a => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:06.248859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84181375-1f6c-47c9-b6aa-0c155347195e None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:06.368389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:06.377583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84181375-1f6c-47c9-b6aa-0c155347195e None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:06.421438 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a569021-8918-4008-bc70-b11847d59f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:06.422654 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a569021-8918-4008-bc70-b11847d59f15 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:06.422944 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a569021-8918-4008-bc70-b11847d59f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:06.423224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a569021-8918-4008-bc70-b11847d59f15 None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:06.426872 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a569021-8918-4008-bc70-b11847d59f15 None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:06.428343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a569021-8918-4008-bc70-b11847d59f15 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:06.430018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 77/149] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:06 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:06.435817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5f4f0-e8c5-407b-9562-1caa343b844f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:06.468671 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:06.554280 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5f4f0-e8c5-407b-9562-1caa343b844f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:06.590394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34219d5d-1567-4a6a-8eef-cc82d3e4723f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:06.591076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34219d5d-1567-4a6a-8eef-cc82d3e4723f None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:06.591358 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34219d5d-1567-4a6a-8eef-cc82d3e4723f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:06.591686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34219d5d-1567-4a6a-8eef-cc82d3e4723f None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3/users/60461a36887841f189cf9a058f0ea39a/roles/8fcc3c7d309e469fad57a0bb086976fd` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:06.593750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34219d5d-1567-4a6a-8eef-cc82d3e4723f None admin] RBAC: Authorizing `identity:create_grant(project_id=106df7e3199d4f9896aebc029a0becf3, user_id=60461a36887841f189cf9a058f0ea39a, role_id=8fcc3c7d309e469fad57a0bb086976fd)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:06.595227 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34219d5d-1567-4a6a-8eef-cc82d3e4723f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:06.596973 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a569021-8918-4008-bc70-b11847d59f15 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:06.627681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 73/150] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:41:06 2022] PUT /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3/users/60461a36887841f189cf9a058f0ea39a/roles/8fcc3c7d309e469fad57a0bb086976fd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:41:06.752092 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a569021-8918-4008-bc70-b11847d59f15 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:06.795781 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee20d1f-1d5b-4798-84dd-2a71393d763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:06.796452 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee20d1f-1d5b-4798-84dd-2a71393d763d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:06.796807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee20d1f-1d5b-4798-84dd-2a71393d763d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:06.797661 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee20d1f-1d5b-4798-84dd-2a71393d763d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:06.817602 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee20d1f-1d5b-4798-84dd-2a71393d763d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-0ee20d1f-1d5b-4798-84dd-2a71393d763d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:06.823665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:06.824493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:06.825389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:06.825389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:06.825389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:06.825389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:06.825389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:06.825389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:06.825389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:06.825389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:06.825389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:06.825389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:06.825389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:06.825389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:06.828610 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 78/151] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:41:06.834096 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34219d5d-1567-4a6a-8eef-cc82d3e4723f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:06.969496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:06.982678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34219d5d-1567-4a6a-8eef-cc82d3e4723f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:07.023520 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb797f82-9907-4fe6-bf88-9d898a0f10ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:07.024149 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb797f82-9907-4fe6-bf88-9d898a0f10ec None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:07.024433 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb797f82-9907-4fe6-bf88-9d898a0f10ec None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:07.024733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb797f82-9907-4fe6-bf88-9d898a0f10ec None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:07.025410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb797f82-9907-4fe6-bf88-9d898a0f10ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:07.025716 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb797f82-9907-4fe6-bf88-9d898a0f10ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:07.027094 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb797f82-9907-4fe6-bf88-9d898a0f10ec None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:07.036446 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 74/152] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:07.042372 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee20d1f-1d5b-4798-84dd-2a71393d763d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:07.080290 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:07.180775 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee20d1f-1d5b-4798-84dd-2a71393d763d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:07.220217 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc01408-3176-4f03-88b7-38434ece6576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:07.220810 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc01408-3176-4f03-88b7-38434ece6576 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:07.221093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc01408-3176-4f03-88b7-38434ece6576 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:07.221372 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc01408-3176-4f03-88b7-38434ece6576 None admin] PATH_INFO: `/v3/users/7e42be56f2284bb4ae4095ef96479453` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:07.222543 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc01408-3176-4f03-88b7-38434ece6576 None admin] RBAC: Authorizing `identity:get_user(user_id=7e42be56f2284bb4ae4095ef96479453)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:07.224018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc01408-3176-4f03-88b7-38434ece6576 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:07.226049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 79/153] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:07 2022] GET /identity/v3/users/7e42be56f2284bb4ae4095ef96479453 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:07.231437 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb797f82-9907-4fe6-bf88-9d898a0f10ec None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:07.369924 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb797f82-9907-4fe6-bf88-9d898a0f10ec None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:07.411771 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5c970-8f76-43b3-b1f5-862e39fae307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:07.412449 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5c970-8f76-43b3-b1f5-862e39fae307 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:07.412760 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5c970-8f76-43b3-b1f5-862e39fae307 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:07.413041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5c970-8f76-43b3-b1f5-862e39fae307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:07.432250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:07.477673 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4c5e6-dec8-4382-a887-fa9db5258326 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:07.477957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4c5e6-dec8-4382-a887-fa9db5258326 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:07.478234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4c5e6-dec8-4382-a887-fa9db5258326 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:07.479751 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 80/154] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:07.485515 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641cf74d-f616-489d-a635-6410459520c9 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:07.485804 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641cf74d-f616-489d-a635-6410459520c9 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:07.486078 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641cf74d-f616-489d-a635-6410459520c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:07.496004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5c970-8f76-43b3-b1f5-862e39fae307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:07.497656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5c970-8f76-43b3-b1f5-862e39fae307 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:07.534373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-641cf74d-f616-489d-a635-6410459520c9 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:07.535595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-641cf74d-f616-489d-a635-6410459520c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:07.630131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 75/155] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:07.636452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5c970-8f76-43b3-b1f5-862e39fae307 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:07.681059 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 81/156] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:07.701809 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5424e3-4e52-49da-ba93-d8d884d52d10 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:07.702101 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5424e3-4e52-49da-ba93-d8d884d52d10 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:07.702361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5424e3-4e52-49da-ba93-d8d884d52d10 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:07.704563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 82/157] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:07.710483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2f93c-6c16-476a-aa7b-1e5c45747383 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:07.710787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2f93c-6c16-476a-aa7b-1e5c45747383 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:07.711047 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2f93c-6c16-476a-aa7b-1e5c45747383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:07.729016 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:07.742674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-97a2f93c-6c16-476a-aa7b-1e5c45747383 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:07.743872 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-97a2f93c-6c16-476a-aa7b-1e5c45747383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:07.783396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:07.808402 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5c970-8f76-43b3-b1f5-862e39fae307 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:07.894818 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 83/158] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:07.901276 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f398423-b33e-4a43-b351-b6b9cd070bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:07.901941 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f398423-b33e-4a43-b351-b6b9cd070bdc None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:07.902228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f398423-b33e-4a43-b351-b6b9cd070bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:07.902507 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f398423-b33e-4a43-b351-b6b9cd070bdc None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:07.903708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f398423-b33e-4a43-b351-b6b9cd070bdc None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:07.905200 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f398423-b33e-4a43-b351-b6b9cd070bdc None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:07.906894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 76/159] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:07 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:07.912865 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2f93c-6c16-476a-aa7b-1e5c45747383 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:08.076512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2f93c-6c16-476a-aa7b-1e5c45747383 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:08.121639 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f398423-b33e-4a43-b351-b6b9cd070bdc None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:08.129303 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319b463-4bca-4bf2-a620-9efc8dc015a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:08.130169 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b463-4bca-4bf2-a620-9efc8dc015a1 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:08.130622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b463-4bca-4bf2-a620-9efc8dc015a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:08.131045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b463-4bca-4bf2-a620-9efc8dc015a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:08.131918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319b463-4bca-4bf2-a620-9efc8dc015a1 None admin] RBAC: Adding query filter params (role.id=eab9c0818aa3414eb3a1a155830ad262, scope.project.id=106df7e3199d4f9896aebc029a0becf3, user.id=7e42be56f2284bb4ae4095ef96479453) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:08.132373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319b463-4bca-4bf2-a620-9efc8dc015a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:08.133981 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319b463-4bca-4bf2-a620-9efc8dc015a1 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:08.140337 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 84/160] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:07 2022] GET /identity/v3/role_assignments?user.id=7e42be56f2284bb4ae4095ef96479453&scope.project.id=106df7e3199d4f9896aebc029a0becf3&role.id=eab9c0818aa3414eb3a1a155830ad262 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:08.266795 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f398423-b33e-4a43-b351-b6b9cd070bdc None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:08.285232 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:08.311998 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7db90-9608-4d34-911c-cb06ea8ea1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:08.312711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7db90-9608-4d34-911c-cb06ea8ea1bb None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:08.312995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7db90-9608-4d34-911c-cb06ea8ea1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:08.313270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7db90-9608-4d34-911c-cb06ea8ea1bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:08.326419 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7db90-9608-4d34-911c-cb06ea8ea1bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-d2a7db90-9608-4d34-911c-cb06ea8ea1bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:08.331466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:08.332360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:08.333171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:08.333171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:08.333171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:08.333171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:08.333171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:08.333171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:08.333171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:08.333171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:08.333171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:08.333171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:08.333171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:08.333171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:08.336668 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 77/161] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:41:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:08.342058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319b463-4bca-4bf2-a620-9efc8dc015a1 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:08.376937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:08.508781 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319b463-4bca-4bf2-a620-9efc8dc015a1 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:08.558863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556b0aa-2d3b-4383-aad5-ba7d81dcc529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:08.559878 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556b0aa-2d3b-4383-aad5-ba7d81dcc529 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:08.560355 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556b0aa-2d3b-4383-aad5-ba7d81dcc529 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:08.560889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556b0aa-2d3b-4383-aad5-ba7d81dcc529 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:08.561796 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556b0aa-2d3b-4383-aad5-ba7d81dcc529 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:08.562322 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556b0aa-2d3b-4383-aad5-ba7d81dcc529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:08.564141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556b0aa-2d3b-4383-aad5-ba7d81dcc529 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:08.574716 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 85/162] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:08.580073 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7db90-9608-4d34-911c-cb06ea8ea1bb None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:08.593662 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556b0aa-2d3b-4383-aad5-ba7d81dcc529 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:08.729210 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:08.756893 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556b0aa-2d3b-4383-aad5-ba7d81dcc529 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:08.778721 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7db90-9608-4d34-911c-cb06ea8ea1bb None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:08.828725 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64c8cd-cce7-4b6b-aa22-23a59f32558e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:08.829613 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64c8cd-cce7-4b6b-aa22-23a59f32558e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:08.830113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64c8cd-cce7-4b6b-aa22-23a59f32558e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:08.830599 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64c8cd-cce7-4b6b-aa22-23a59f32558e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:08.853561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64c8cd-cce7-4b6b-aa22-23a59f32558e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-ae64c8cd-cce7-4b6b-aa22-23a59f32558e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:08.859442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:08.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:08.861077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:08.861077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:08.861077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:08.861077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:08.861077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:08.861077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:08.861077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:08.861077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:08.861077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:08.861077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:08.861077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:08.861077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:08.863357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 86/163] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:41:08.869703 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64c8cd-cce7-4b6b-aa22-23a59f32558e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:08.889273 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c43c8-d593-443c-8ad9-4643f59b49aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:08.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c43c8-d593-443c-8ad9-4643f59b49aa None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:08.890206 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c43c8-d593-443c-8ad9-4643f59b49aa None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:08.890480 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c43c8-d593-443c-8ad9-4643f59b49aa None admin] PATH_INFO: `/v3/users/7e42be56f2284bb4ae4095ef96479453` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:08.892221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c43c8-d593-443c-8ad9-4643f59b49aa None admin] RBAC: Authorizing `identity:get_user(user_id=7e42be56f2284bb4ae4095ef96479453)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:08.893698 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c43c8-d593-443c-8ad9-4643f59b49aa None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:08.895762 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 78/164] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:08 2022] GET /identity/v3/users/7e42be56f2284bb4ae4095ef96479453 => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:08.897067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ef4dc-c656-4128-adfa-baa8dff6c950 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:08.897483 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ef4dc-c656-4128-adfa-baa8dff6c950 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:08.897909 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ef4dc-c656-4128-adfa-baa8dff6c950 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:08.904575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 79/165] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:08.905977 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237700f-2318-442a-9e69-fc48b4199d83 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:08.906975 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237700f-2318-442a-9e69-fc48b4199d83 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:08.907405 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237700f-2318-442a-9e69-fc48b4199d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:08.941595 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-9237700f-2318-442a-9e69-fc48b4199d83 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:08.943054 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-9237700f-2318-442a-9e69-fc48b4199d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:09.013782 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:09.036935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64c8cd-cce7-4b6b-aa22-23a59f32558e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:09.043206 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 80/166] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:09.044093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237700f-2318-442a-9e69-fc48b4199d83 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:09.108457 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9ae52-38b9-494a-a382-67716731a32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:09.109028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9ae52-38b9-494a-a382-67716731a32f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:09.109354 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9ae52-38b9-494a-a382-67716731a32f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:09.109644 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9ae52-38b9-494a-a382-67716731a32f None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:09.110319 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9ae52-38b9-494a-a382-67716731a32f None admin] RBAC: Adding query filter params (name=member) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:09.110624 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9ae52-38b9-494a-a382-67716731a32f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:09.112229 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9ae52-38b9-494a-a382-67716731a32f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:09.113826 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:09.132177 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 87/167] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:09.137076 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9ae52-38b9-494a-a382-67716731a32f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:09.181226 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237700f-2318-442a-9e69-fc48b4199d83 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:09.219148 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7f574-557d-4cde-a955-8302ae2d35a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:09.220073 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7f574-557d-4cde-a955-8302ae2d35a4 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:09.220510 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7f574-557d-4cde-a955-8302ae2d35a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:09.220962 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7f574-557d-4cde-a955-8302ae2d35a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:09.266204 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:09.293808 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7f574-557d-4cde-a955-8302ae2d35a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:09.295510 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7f574-557d-4cde-a955-8302ae2d35a4 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:09.311971 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9ae52-38b9-494a-a382-67716731a32f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:09.377682 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4445f1-827b-4795-adfe-9e55565672b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:09.378385 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4445f1-827b-4795-adfe-9e55565672b8 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:09.378877 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4445f1-827b-4795-adfe-9e55565672b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:09.379053 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4445f1-827b-4795-adfe-9e55565672b8 None admin] PATH_INFO: `/v3/users/7e42be56f2284bb4ae4095ef96479453` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:09.381345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4445f1-827b-4795-adfe-9e55565672b8 None admin] RBAC: Authorizing `identity:get_user(user_id=7e42be56f2284bb4ae4095ef96479453)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:09.382920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4445f1-827b-4795-adfe-9e55565672b8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:09.384943 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 88/168] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:09 2022] GET /identity/v3/users/7e42be56f2284bb4ae4095ef96479453 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:09.390079 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4445f1-827b-4795-adfe-9e55565672b8 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:09.402818 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 81/169] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:09.408236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7f574-557d-4cde-a955-8302ae2d35a4 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:09.497401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:09.508404 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:09.534863 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7f574-557d-4cde-a955-8302ae2d35a4 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:09.560410 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4445f1-827b-4795-adfe-9e55565672b8 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:09.571893 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5ad91-f8d6-4522-98c3-5819ebc57e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:09.572791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5ad91-f8d6-4522-98c3-5819ebc57e31 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:09.573498 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5ad91-f8d6-4522-98c3-5819ebc57e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:09.573911 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5ad91-f8d6-4522-98c3-5819ebc57e31 None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:09.575202 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5ad91-f8d6-4522-98c3-5819ebc57e31 None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:09.576901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5ad91-f8d6-4522-98c3-5819ebc57e31 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:09.578833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 82/170] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:09 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:09.584630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5ad91-f8d6-4522-98c3-5819ebc57e31 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:09.633887 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8a237-830b-4be5-8eb1-39223a8f66cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:09.634430 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8a237-830b-4be5-8eb1-39223a8f66cb None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:09.634708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8a237-830b-4be5-8eb1-39223a8f66cb None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:09.634981 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8a237-830b-4be5-8eb1-39223a8f66cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:09.769809 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8a237-830b-4be5-8eb1-39223a8f66cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:09.772154 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8a237-830b-4be5-8eb1-39223a8f66cb None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:09.848903 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5ad91-f8d6-4522-98c3-5819ebc57e31 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:09.869038 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:09.893374 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828381de-7644-4f54-a577-7a2075461444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:09.894254 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828381de-7644-4f54-a577-7a2075461444 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:09.894677 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828381de-7644-4f54-a577-7a2075461444 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:09.895232 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828381de-7644-4f54-a577-7a2075461444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:09.896192 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828381de-7644-4f54-a577-7a2075461444 None admin] RBAC: Adding query filter params (role.id=3ebdb28c195f447294810f1033bb8e62, scope.project.id=106df7e3199d4f9896aebc029a0becf3, user.id=7e42be56f2284bb4ae4095ef96479453) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:09.896776 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828381de-7644-4f54-a577-7a2075461444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:09.898360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828381de-7644-4f54-a577-7a2075461444 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:09.904804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 83/171] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:09 2022] GET /identity/v3/role_assignments?user.id=7e42be56f2284bb4ae4095ef96479453&scope.project.id=106df7e3199d4f9896aebc029a0becf3&role.id=3ebdb28c195f447294810f1033bb8e62 => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:09.905805 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828381de-7644-4f54-a577-7a2075461444 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:09.933398 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:09.935165 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 89/172] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:41:09.940881 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8a237-830b-4be5-8eb1-39223a8f66cb None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:10.023496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828381de-7644-4f54-a577-7a2075461444 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:10.062895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994c17d-8ca8-4a07-8654-daea379a4053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:10.063889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994c17d-8ca8-4a07-8654-daea379a4053 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:10.064501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994c17d-8ca8-4a07-8654-daea379a4053 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:10.065006 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994c17d-8ca8-4a07-8654-daea379a4053 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:10.080865 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994c17d-8ca8-4a07-8654-daea379a4053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-2994c17d-8ca8-4a07-8654-daea379a4053 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:10.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:10.094448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:10.095212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:10.095212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:10.095212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:10.095212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:10.095212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:10.095212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:10.095212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:10.095212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:10.095212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:10.095212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:10.095212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:10.095212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:10.098678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 84/173] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:10.104335 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994c17d-8ca8-4a07-8654-daea379a4053 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:10.118540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8a237-830b-4be5-8eb1-39223a8f66cb None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:10.181793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5e7a0-9e84-4bc2-84ee-a309d670bfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:10.182379 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e7a0-9e84-4bc2-84ee-a309d670bfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:10.182652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e7a0-9e84-4bc2-84ee-a309d670bfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:10.182925 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e7a0-9e84-4bc2-84ee-a309d670bfe0 None admin] PATH_INFO: `/v3/projects/25114217f4e74d8bbd75b0a3a1f6f105` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:10.187289 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5e7a0-9e84-4bc2-84ee-a309d670bfe0 None admin] RBAC: Authorizing `identity:get_project(project_id=25114217f4e74d8bbd75b0a3a1f6f105)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:10.188853 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:10.189292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5e7a0-9e84-4bc2-84ee-a309d670bfe0 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:10.192010 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 90/174] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:09 2022] GET /identity/v3/projects/25114217f4e74d8bbd75b0a3a1f6f105 => generated 312 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:10.198666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5e7a0-9e84-4bc2-84ee-a309d670bfe0 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:10.242535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994c17d-8ca8-4a07-8654-daea379a4053 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:10.266190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:10.282993 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db98d2-bbb3-4bed-807d-f6dea51a9ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:10.283962 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db98d2-bbb3-4bed-807d-f6dea51a9ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:10.284448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db98d2-bbb3-4bed-807d-f6dea51a9ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:10.284926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db98d2-bbb3-4bed-807d-f6dea51a9ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:10.285901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db98d2-bbb3-4bed-807d-f6dea51a9ea7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:10.286383 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db98d2-bbb3-4bed-807d-f6dea51a9ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:10.288133 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db98d2-bbb3-4bed-807d-f6dea51a9ea7 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:10.297890 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 85/175] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:10.303549 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db98d2-bbb3-4bed-807d-f6dea51a9ea7 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:10.412273 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5e7a0-9e84-4bc2-84ee-a309d670bfe0 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:10.462635 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c25ed0-5e92-41d2-ad05-d858eb1e5426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:10.463527 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c25ed0-5e92-41d2-ad05-d858eb1e5426 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:10.463998 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c25ed0-5e92-41d2-ad05-d858eb1e5426 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:10.464445 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c25ed0-5e92-41d2-ad05-d858eb1e5426 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:10.465432 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c25ed0-5e92-41d2-ad05-d858eb1e5426 None admin] RBAC: Adding query filter params (role.id=eab9c0818aa3414eb3a1a155830ad262, scope.project.id=25114217f4e74d8bbd75b0a3a1f6f105, user.id=7e42be56f2284bb4ae4095ef96479453) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:10.465918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c25ed0-5e92-41d2-ad05-d858eb1e5426 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:10.468043 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c25ed0-5e92-41d2-ad05-d858eb1e5426 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:10.476881 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 91/176] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:10 2022] GET /identity/v3/role_assignments?user.id=7e42be56f2284bb4ae4095ef96479453&scope.project.id=25114217f4e74d8bbd75b0a3a1f6f105&role.id=eab9c0818aa3414eb3a1a155830ad262 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:10.478854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c253e8-5aa6-4c41-8f78-ef0d8f95d59f None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:10.479582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c253e8-5aa6-4c41-8f78-ef0d8f95d59f None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:10.480104 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c253e8-5aa6-4c41-8f78-ef0d8f95d59f None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:10.481849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 92/177] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:10.488844 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ecec-2379-4497-ba48-ffb15740bae4 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:10.489515 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ecec-2379-4497-ba48-ffb15740bae4 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:10.489998 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ecec-2379-4497-ba48-ffb15740bae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:10.510952 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-9086ecec-2379-4497-ba48-ffb15740bae4 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:10.512862 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-9086ecec-2379-4497-ba48-ffb15740bae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:10.542750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db98d2-bbb3-4bed-807d-f6dea51a9ea7 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:10.622451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 93/178] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:10.626113 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:10.645422 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc901a87-35b8-4a63-bcad-c9c29f31f56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:10.646093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc901a87-35b8-4a63-bcad-c9c29f31f56e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:10.646374 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc901a87-35b8-4a63-bcad-c9c29f31f56e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:10.646651 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc901a87-35b8-4a63-bcad-c9c29f31f56e None admin] PATH_INFO: `/v3/users/19c04946a10143a58b50e26046837bb9` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:10.647934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc901a87-35b8-4a63-bcad-c9c29f31f56e None admin] RBAC: Authorizing `identity:get_user(user_id=19c04946a10143a58b50e26046837bb9)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:10.649428 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc901a87-35b8-4a63-bcad-c9c29f31f56e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:10.651195 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 86/179] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:10 2022] GET /identity/v3/users/19c04946a10143a58b50e26046837bb9 => generated 247 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:10.656741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086ecec-2379-4497-ba48-ffb15740bae4 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:10.705580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:10.814885 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086ecec-2379-4497-ba48-ffb15740bae4 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:10.866981 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9ed06-c279-461a-8533-1c65eca90f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:10.867608 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9ed06-c279-461a-8533-1c65eca90f82 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:10.867886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9ed06-c279-461a-8533-1c65eca90f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:10.868162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9ed06-c279-461a-8533-1c65eca90f82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:10.966424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9ed06-c279-461a-8533-1c65eca90f82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:10.967903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9ed06-c279-461a-8533-1c65eca90f82 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:10.978499 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78ca4-f682-444c-8d50-f6acf1e6edce None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:10.978804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78ca4-f682-444c-8d50-f6acf1e6edce None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:10.979054 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78ca4-f682-444c-8d50-f6acf1e6edce None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:10.980702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 87/180] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:10.986297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a06682-3c6c-4527-8468-7c59b83e882b None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:10.986578 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a06682-3c6c-4527-8468-7c59b83e882b None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:10.986852 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a06682-3c6c-4527-8468-7c59b83e882b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:11.019444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:11.020776 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-f7a06682-3c6c-4527-8468-7c59b83e882b None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:11.021991 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-f7a06682-3c6c-4527-8468-7c59b83e882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:11.105078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 88/181] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:11.106322 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a06682-3c6c-4527-8468-7c59b83e882b None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:11.128250 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 94/182] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:11.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9ed06-c279-461a-8533-1c65eca90f82 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:11.274824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a06682-3c6c-4527-8468-7c59b83e882b None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:11.301807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9ed06-c279-461a-8533-1c65eca90f82 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:11.313962 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:11.325548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54100e2-afe3-4167-8993-36c7531e9346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:11.326182 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54100e2-afe3-4167-8993-36c7531e9346 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:11.326461 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54100e2-afe3-4167-8993-36c7531e9346 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:11.326733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54100e2-afe3-4167-8993-36c7531e9346 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:11.333914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:11.342955 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54100e2-afe3-4167-8993-36c7531e9346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:11.344386 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d7a23-9d34-488f-9589-d0b75e72d3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:11.345263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d7a23-9d34-488f-9589-d0b75e72d3bf None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:11.345734 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d7a23-9d34-488f-9589-d0b75e72d3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:11.346211 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d7a23-9d34-488f-9589-d0b75e72d3bf None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:11.347595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d7a23-9d34-488f-9589-d0b75e72d3bf None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-e54100e2-afe3-4167-8993-36c7531e9346 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:11.347831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:11.348724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:11.349522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:11.349522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:11.349522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:11.349522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:11.349522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:11.349522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:11.349522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:11.349522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:11.349522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:11.349522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:11.349522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:11.349522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:11.349522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 89/183] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:41:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:11.350628 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f6e84-b06f-4e62-88b2-74b26f0e4ee8 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:11.350845 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f6e84-b06f-4e62-88b2-74b26f0e4ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:11.351120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f6e84-b06f-4e62-88b2-74b26f0e4ee8 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:11.352347 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 90/184] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:11.356857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d7a23-9d34-488f-9589-d0b75e72d3bf None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:11.358184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be888f9-ac2d-4b40-b422-2d0e0c1d2c8c None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:11.358470 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be888f9-ac2d-4b40-b422-2d0e0c1d2c8c None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:11.358744 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be888f9-ac2d-4b40-b422-2d0e0c1d2c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:11.359548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 95/185] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:11 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:11.360508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d7a23-9d34-488f-9589-d0b75e72d3bf None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:11.382748 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-5be888f9-ac2d-4b40-b422-2d0e0c1d2c8c None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:11.383956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-5be888f9-ac2d-4b40-b422-2d0e0c1d2c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:11.456094 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 91/186] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:11.468911 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be888f9-ac2d-4b40-b422-2d0e0c1d2c8c None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:11.479711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d7a23-9d34-488f-9589-d0b75e72d3bf None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:11.514542 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21347222-5e4f-4ad1-b46b-097157a3568f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:11.515155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347222-5e4f-4ad1-b46b-097157a3568f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:11.515435 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347222-5e4f-4ad1-b46b-097157a3568f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:11.516270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347222-5e4f-4ad1-b46b-097157a3568f None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:11.516993 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21347222-5e4f-4ad1-b46b-097157a3568f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:11.517285 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21347222-5e4f-4ad1-b46b-097157a3568f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:11.518669 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21347222-5e4f-4ad1-b46b-097157a3568f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:11.526677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 96/187] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:11.527664 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e78a8-4862-4692-bdcc-d20f338b0047 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:11.527965 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e78a8-4862-4692-bdcc-d20f338b0047 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:11.528237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e78a8-4862-4692-bdcc-d20f338b0047 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:11.532615 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 97/188] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:11.532615 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e78a8-4862-4692-bdcc-d20f338b0047 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:11.564796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be888f9-ac2d-4b40-b422-2d0e0c1d2c8c None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:11.581758 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:11.588524 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:11.602758 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda5755-d241-47d7-bdda-e47042646e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:11.603367 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda5755-d241-47d7-bdda-e47042646e07 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:11.603643 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda5755-d241-47d7-bdda-e47042646e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:11.603915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda5755-d241-47d7-bdda-e47042646e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:11.604731 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda5755-d241-47d7-bdda-e47042646e07 None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=106df7e3199d4f9896aebc029a0becf3, user.id=19c04946a10143a58b50e26046837bb9) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:11.605040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda5755-d241-47d7-bdda-e47042646e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:11.606534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda5755-d241-47d7-bdda-e47042646e07 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:11.612675 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 92/189] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:11 2022] GET /identity/v3/role_assignments?user.id=19c04946a10143a58b50e26046837bb9&scope.project.id=106df7e3199d4f9896aebc029a0becf3&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:11.613395 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda5755-d241-47d7-bdda-e47042646e07 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:11.657230 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e78a8-4862-4692-bdcc-d20f338b0047 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:11.712801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced61761-9406-4c6a-92a5-3bf16e745d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:11.714826 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61761-9406-4c6a-92a5-3bf16e745d46 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:11.715330 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61761-9406-4c6a-92a5-3bf16e745d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:11.715790 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61761-9406-4c6a-92a5-3bf16e745d46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:11.731456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda5755-d241-47d7-bdda-e47042646e07 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:11.731836 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced61761-9406-4c6a-92a5-3bf16e745d46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-ced61761-9406-4c6a-92a5-3bf16e745d46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:11.738086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:11.739018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:11.739778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:11.739778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:11.739778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:11.739778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:11.739778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:11.739778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:11.739778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:11.739778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:11.739778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:11.739778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:11.739778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:11.739778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:11.739778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 98/190] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:11.741453 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d0577-0649-45e4-bbb9-53be0cbf5732 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:11.741453 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d0577-0649-45e4-bbb9-53be0cbf5732 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:11.741453 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d0577-0649-45e4-bbb9-53be0cbf5732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:11.759972 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-a21d0577-0649-45e4-bbb9-53be0cbf5732 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:11.761235 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-a21d0577-0649-45e4-bbb9-53be0cbf5732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:11.776443 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a1b02-7f94-4278-a275-5cf1bd482523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:11.777144 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a1b02-7f94-4278-a275-5cf1bd482523 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:11.777420 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a1b02-7f94-4278-a275-5cf1bd482523 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:11.777698 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a1b02-7f94-4278-a275-5cf1bd482523 None admin] PATH_INFO: `/v3/users/2c9a89aad5ed45668bd6ae876d9b6952` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:11.796039 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a1b02-7f94-4278-a275-5cf1bd482523 None admin] RBAC: Authorizing `identity:get_user(user_id=2c9a89aad5ed45668bd6ae876d9b6952)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:11.798068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a1b02-7f94-4278-a275-5cf1bd482523 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:11.801722 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 93/191] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:11 2022] GET /identity/v3/users/2c9a89aad5ed45668bd6ae876d9b6952 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:11.801722 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a1b02-7f94-4278-a275-5cf1bd482523 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:11.843534 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 99/192] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:11.844401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d0577-0649-45e4-bbb9-53be0cbf5732 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:11.869315 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:11.899398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:11.933702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a1b02-7f94-4278-a275-5cf1bd482523 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:11.962740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d0577-0649-45e4-bbb9-53be0cbf5732 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:11.969610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195adb64-2e42-41da-8e1b-d69ce505a01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:11.970640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195adb64-2e42-41da-8e1b-d69ce505a01a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:11.970927 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195adb64-2e42-41da-8e1b-d69ce505a01a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:11.971203 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195adb64-2e42-41da-8e1b-d69ce505a01a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:11.972705 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195adb64-2e42-41da-8e1b-d69ce505a01a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:11.974477 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195adb64-2e42-41da-8e1b-d69ce505a01a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:11.976354 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 94/193] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:11.977210 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195adb64-2e42-41da-8e1b-d69ce505a01a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:12.003982 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816ff64-fe6d-413f-9855-294c81cbc2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:12.004873 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816ff64-fe6d-413f-9855-294c81cbc2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:12.005270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816ff64-fe6d-413f-9855-294c81cbc2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:12.005550 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816ff64-fe6d-413f-9855-294c81cbc2a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:12.006218 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816ff64-fe6d-413f-9855-294c81cbc2a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:12.006522 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816ff64-fe6d-413f-9855-294c81cbc2a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:12.008021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816ff64-fe6d-413f-9855-294c81cbc2a8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:12.021625 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 100/194] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:12.021625 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816ff64-fe6d-413f-9855-294c81cbc2a8 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:12.083328 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195adb64-2e42-41da-8e1b-d69ce505a01a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:12.090478 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:12.120823 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f8e17-03c2-41af-8f04-2fa3c507f90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:12.121362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f8e17-03c2-41af-8f04-2fa3c507f90f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:12.121637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f8e17-03c2-41af-8f04-2fa3c507f90f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:12.121909 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f8e17-03c2-41af-8f04-2fa3c507f90f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:12.124081 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816ff64-fe6d-413f-9855-294c81cbc2a8 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:12.133451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:12.158842 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b28a5-af19-451f-9136-3b092a947c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:12.159442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b28a5-af19-451f-9136-3b092a947c02 None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:12.159721 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b28a5-af19-451f-9136-3b092a947c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:12.159995 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b28a5-af19-451f-9136-3b092a947c02 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:12.160686 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b28a5-af19-451f-9136-3b092a947c02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:12.162148 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b28a5-af19-451f-9136-3b092a947c02 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:12.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 101/195] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:41:12 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:41:12.189274 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b28a5-af19-451f-9136-3b092a947c02 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:12.204460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f8e17-03c2-41af-8f04-2fa3c507f90f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:12.206276 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f8e17-03c2-41af-8f04-2fa3c507f90f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:12.300778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b28a5-af19-451f-9136-3b092a947c02 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:12.313627 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 95/196] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:12.313627 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f8e17-03c2-41af-8f04-2fa3c507f90f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:12.324288 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:12.344412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0409c-f71e-413a-8139-5798268e3f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:12.345105 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0409c-f71e-413a-8139-5798268e3f6b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:12.345389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0409c-f71e-413a-8139-5798268e3f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:12.345667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0409c-f71e-413a-8139-5798268e3f6b None admin] PATH_INFO: `/v3/users/60461a36887841f189cf9a058f0ea39a` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:12.346867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0409c-f71e-413a-8139-5798268e3f6b None admin] RBAC: Authorizing `identity:get_user(user_id=60461a36887841f189cf9a058f0ea39a)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:12.348372 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0409c-f71e-413a-8139-5798268e3f6b None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:12.350232 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 102/197] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:12 2022] GET /identity/v3/users/60461a36887841f189cf9a058f0ea39a => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:12.353486 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0409c-f71e-413a-8139-5798268e3f6b None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:12.388006 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:12.440718 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f8e17-03c2-41af-8f04-2fa3c507f90f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:12.482889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68999db9-8060-4321-9cb7-a2d7392e3993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:12.483113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0409c-f71e-413a-8139-5798268e3f6b None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:12.483509 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68999db9-8060-4321-9cb7-a2d7392e3993 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:12.483751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68999db9-8060-4321-9cb7-a2d7392e3993 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:12.484027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68999db9-8060-4321-9cb7-a2d7392e3993 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:12.499430 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68999db9-8060-4321-9cb7-a2d7392e3993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-68999db9-8060-4321-9cb7-a2d7392e3993 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:12.505641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:12.506684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:12.507640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:12.507640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:12.507640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:12.507640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:12.507640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:12.507640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:12.507640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:12.507640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:12.507640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:12.507640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:12.507640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:12.507640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:12.507640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 96/198] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:41:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:12.508424 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68999db9-8060-4321-9cb7-a2d7392e3993 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:12.528688 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ce7ae-aa86-4c84-9e19-e82ef50bd61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:12.529340 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce7ae-aa86-4c84-9e19-e82ef50bd61d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:12.529618 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce7ae-aa86-4c84-9e19-e82ef50bd61d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:12.529909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce7ae-aa86-4c84-9e19-e82ef50bd61d None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:12.531030 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ce7ae-aa86-4c84-9e19-e82ef50bd61d None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:12.532522 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ce7ae-aa86-4c84-9e19-e82ef50bd61d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:12.534176 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 103/199] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:12 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:12.534936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ce7ae-aa86-4c84-9e19-e82ef50bd61d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:12.592937 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:12.635249 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68999db9-8060-4321-9cb7-a2d7392e3993 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:12.649383 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:12.652938 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ce7ae-aa86-4c84-9e19-e82ef50bd61d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:12.677111 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f25030-b635-4fa8-9b20-716c76c99ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:12.677731 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f25030-b635-4fa8-9b20-716c76c99ecd None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:12.678014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f25030-b635-4fa8-9b20-716c76c99ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:12.678296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f25030-b635-4fa8-9b20-716c76c99ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:12.690970 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc316-2fd3-4137-a16d-0216845fedad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:12.691587 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc316-2fd3-4137-a16d-0216845fedad None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:12.691868 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc316-2fd3-4137-a16d-0216845fedad None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:12.692147 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc316-2fd3-4137-a16d-0216845fedad None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:12.692899 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bc316-2fd3-4137-a16d-0216845fedad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:12.693202 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bc316-2fd3-4137-a16d-0216845fedad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:12.694639 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bc316-2fd3-4137-a16d-0216845fedad None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:12.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 104/200] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:12.707055 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc316-2fd3-4137-a16d-0216845fedad None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:12.755644 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f25030-b635-4fa8-9b20-716c76c99ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:12.757686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f25030-b635-4fa8-9b20-716c76c99ecd None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:12.813415 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc316-2fd3-4137-a16d-0216845fedad None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:12.840963 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:12.855316 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0ee75-5b8f-4729-8825-b8cc5d186363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:12.856076 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0ee75-5b8f-4729-8825-b8cc5d186363 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:12.856454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0ee75-5b8f-4729-8825-b8cc5d186363 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:12.856858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0ee75-5b8f-4729-8825-b8cc5d186363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:12.857699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0ee75-5b8f-4729-8825-b8cc5d186363 None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=1c228a61fd2544379846b2c8a69fd2c3, user.id=2c9a89aad5ed45668bd6ae876d9b6952) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:12.858112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0ee75-5b8f-4729-8825-b8cc5d186363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:12.860524 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0ee75-5b8f-4729-8825-b8cc5d186363 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:12.866419 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 105/201] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:12 2022] GET /identity/v3/role_assignments?user.id=2c9a89aad5ed45668bd6ae876d9b6952&scope.project.id=1c228a61fd2544379846b2c8a69fd2c3&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:12.867317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0ee75-5b8f-4729-8825-b8cc5d186363 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:12.886957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 97/202] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:12.896717 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f25030-b635-4fa8-9b20-716c76c99ecd None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:12.898948 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:12.996308 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0ee75-5b8f-4729-8825-b8cc5d186363 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:13.026680 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f25030-b635-4fa8-9b20-716c76c99ecd None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:13.063744 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b53eb-fef6-4b59-b6a5-d8ea214716b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:13.064442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b53eb-fef6-4b59-b6a5-d8ea214716b8 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:13.064769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b53eb-fef6-4b59-b6a5-d8ea214716b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:13.065051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b53eb-fef6-4b59-b6a5-d8ea214716b8 None admin] PATH_INFO: `/v3/users/2c9a89aad5ed45668bd6ae876d9b6952` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:13.066268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b53eb-fef6-4b59-b6a5-d8ea214716b8 None admin] RBAC: Authorizing `identity:get_user(user_id=2c9a89aad5ed45668bd6ae876d9b6952)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:13.068818 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b53eb-fef6-4b59-b6a5-d8ea214716b8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:13.070850 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 106/203] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:12 2022] GET /identity/v3/users/2c9a89aad5ed45668bd6ae876d9b6952 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:13.076653 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b53eb-fef6-4b59-b6a5-d8ea214716b8 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:13.083581 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eedb13-598f-44c6-9245-1f058f4576c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:13.084218 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eedb13-598f-44c6-9245-1f058f4576c2 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:13.084496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eedb13-598f-44c6-9245-1f058f4576c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:13.084835 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eedb13-598f-44c6-9245-1f058f4576c2 None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:13.085986 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eedb13-598f-44c6-9245-1f058f4576c2 None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:13.087428 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eedb13-598f-44c6-9245-1f058f4576c2 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:13.089212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 98/204] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:12 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:13.096291 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eedb13-598f-44c6-9245-1f058f4576c2 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:13.151459 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:13.245938 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:13.258803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b53eb-fef6-4b59-b6a5-d8ea214716b8 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:13.283965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eedb13-598f-44c6-9245-1f058f4576c2 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:13.298933 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5b8e8-226d-4994-a492-c3ded5658291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:13.299381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5b8e8-226d-4994-a492-c3ded5658291 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:13.299667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5b8e8-226d-4994-a492-c3ded5658291 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:13.299946 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5b8e8-226d-4994-a492-c3ded5658291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:13.345260 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165330f-d0be-43c5-b5a3-4981098ec956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:13.346566 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165330f-d0be-43c5-b5a3-4981098ec956 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:13.347051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165330f-d0be-43c5-b5a3-4981098ec956 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:13.347523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165330f-d0be-43c5-b5a3-4981098ec956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:13.348480 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165330f-d0be-43c5-b5a3-4981098ec956 None admin] RBAC: Adding query filter params (role.id=8fcc3c7d309e469fad57a0bb086976fd, scope.project.id=106df7e3199d4f9896aebc029a0becf3, user.id=60461a36887841f189cf9a058f0ea39a) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:13.349045 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165330f-d0be-43c5-b5a3-4981098ec956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:13.350678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165330f-d0be-43c5-b5a3-4981098ec956 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:13.363931 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 99/205] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:13 2022] GET /identity/v3/role_assignments?user.id=60461a36887841f189cf9a058f0ea39a&scope.project.id=106df7e3199d4f9896aebc029a0becf3&role.id=8fcc3c7d309e469fad57a0bb086976fd => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:13.375413 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5b8e8-226d-4994-a492-c3ded5658291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:13.377279 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5b8e8-226d-4994-a492-c3ded5658291 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:13.504178 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:13.518009 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 107/206] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:41:13.523708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165330f-d0be-43c5-b5a3-4981098ec956 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:13.665758 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:13.669694 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165330f-d0be-43c5-b5a3-4981098ec956 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:13.715314 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585407d-36de-4fe5-b6d3-56c5fb857425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:13.715974 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585407d-36de-4fe5-b6d3-56c5fb857425 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:13.716257 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585407d-36de-4fe5-b6d3-56c5fb857425 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:13.716537 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585407d-36de-4fe5-b6d3-56c5fb857425 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:13.717762 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585407d-36de-4fe5-b6d3-56c5fb857425 None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:13.719252 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585407d-36de-4fe5-b6d3-56c5fb857425 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:13.721291 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 100/207] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:13 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:13.726646 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5b8e8-226d-4994-a492-c3ded5658291 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:13.846172 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5b8e8-226d-4994-a492-c3ded5658291 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:13.884071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c047019-0c83-443a-80b1-440496a71467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:13.884725 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c047019-0c83-443a-80b1-440496a71467 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:13.885009 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c047019-0c83-443a-80b1-440496a71467 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:13.885282 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c047019-0c83-443a-80b1-440496a71467 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:13.886029 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c047019-0c83-443a-80b1-440496a71467 None admin] RBAC: Adding query filter params (role.id=3ebdb28c195f447294810f1033bb8e62, scope.project.id=1c228a61fd2544379846b2c8a69fd2c3, user.id=2c9a89aad5ed45668bd6ae876d9b6952) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:13.886412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c047019-0c83-443a-80b1-440496a71467 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:13.887915 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c047019-0c83-443a-80b1-440496a71467 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:13.895500 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 108/208] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:13 2022] GET /identity/v3/role_assignments?user.id=2c9a89aad5ed45668bd6ae876d9b6952&scope.project.id=1c228a61fd2544379846b2c8a69fd2c3&role.id=3ebdb28c195f447294810f1033bb8e62 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:14.762224 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d45dc9-e7a3-4ac1-b126-024b21f1c36e None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:14.762747 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d45dc9-e7a3-4ac1-b126-024b21f1c36e None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:14.762747 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d45dc9-e7a3-4ac1-b126-024b21f1c36e None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:14.764367 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 101/209] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:14.770803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb48fa-2901-4c16-be19-e0fcabc0bd09 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:14.771697 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb48fa-2901-4c16-be19-e0fcabc0bd09 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:14.772168 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb48fa-2901-4c16-be19-e0fcabc0bd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:14.794638 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-3edb48fa-2901-4c16-be19-e0fcabc0bd09 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:14.795848 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-3edb48fa-2901-4c16-be19-e0fcabc0bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:14.814651 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387e3f2-9628-4d67-88b4-e181e1680008 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:14.814951 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387e3f2-9628-4d67-88b4-e181e1680008 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:14.815203 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387e3f2-9628-4d67-88b4-e181e1680008 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:14.818288 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 102/210] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:14.825351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01284a-0454-41ba-b46d-6ab343c9e157 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:14.825542 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01284a-0454-41ba-b46d-6ab343c9e157 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:14.825763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01284a-0454-41ba-b46d-6ab343c9e157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:14.846488 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-0f01284a-0454-41ba-b46d-6ab343c9e157 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:14.847678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-0f01284a-0454-41ba-b46d-6ab343c9e157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:14.878815 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:14.895247 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 109/211] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:14.920796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 103/212] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:15.164879 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb48fa-2901-4c16-be19-e0fcabc0bd09 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:15.202010 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01284a-0454-41ba-b46d-6ab343c9e157 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:15.269740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb48fa-2901-4c16-be19-e0fcabc0bd09 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:15.301716 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:15.306212 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82c7e6-08dc-4fa1-9427-d07a0b71b8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:15.306879 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82c7e6-08dc-4fa1-9427-d07a0b71b8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:15.307161 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82c7e6-08dc-4fa1-9427-d07a0b71b8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:15.307431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82c7e6-08dc-4fa1-9427-d07a0b71b8f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:15.308367 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01284a-0454-41ba-b46d-6ab343c9e157 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:15.318137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82c7e6-08dc-4fa1-9427-d07a0b71b8f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-ca82c7e6-08dc-4fa1-9427-d07a0b71b8f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:15.322991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:15.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:15.325283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:15.325283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:15.325283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:15.325283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:15.325283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:15.325283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:15.325283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:15.325283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:15.325283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:15.325283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:15.325283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:15.325283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:15.325283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 110/213] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:15.326267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e5baa-da16-4964-9461-b43dc8c0ea94 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:15.326551 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e5baa-da16-4964-9461-b43dc8c0ea94 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:15.326821 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e5baa-da16-4964-9461-b43dc8c0ea94 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:15.328991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 111/214] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:15.333367 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e5baa-da16-4964-9461-b43dc8c0ea94 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:15.350452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6535f30-8ff0-40d8-8c72-0e7ed6cc0ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:15.351077 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6535f30-8ff0-40d8-8c72-0e7ed6cc0ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:15.351355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6535f30-8ff0-40d8-8c72-0e7ed6cc0ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:15.351640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6535f30-8ff0-40d8-8c72-0e7ed6cc0ba0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:15.352772 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6535f30-8ff0-40d8-8c72-0e7ed6cc0ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:15.354206 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6535f30-8ff0-40d8-8c72-0e7ed6cc0ba0 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:15.356591 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 104/215] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:15.356893 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3337da6-b45e-49aa-bf4a-16c2f4efaefc None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:15.357130 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3337da6-b45e-49aa-bf4a-16c2f4efaefc None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:15.357400 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3337da6-b45e-49aa-bf4a-16c2f4efaefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:15.374457 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-c3337da6-b45e-49aa-bf4a-16c2f4efaefc None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:15.376159 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-c3337da6-b45e-49aa-bf4a-16c2f4efaefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:15.393269 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:15.445111 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e5baa-da16-4964-9461-b43dc8c0ea94 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:15.456704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 105/216] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:15.456704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3337da6-b45e-49aa-bf4a-16c2f4efaefc None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:15.498163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54ee0d-8e15-4cf2-a537-29e11a006904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:15.498791 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54ee0d-8e15-4cf2-a537-29e11a006904 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:15.499068 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54ee0d-8e15-4cf2-a537-29e11a006904 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:15.499344 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54ee0d-8e15-4cf2-a537-29e11a006904 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:15.500682 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54ee0d-8e15-4cf2-a537-29e11a006904 None admin] RBAC: Adding query filter params (name=member) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:15.501255 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54ee0d-8e15-4cf2-a537-29e11a006904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:15.504637 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54ee0d-8e15-4cf2-a537-29e11a006904 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:15.515819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 112/217] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:15.521622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54ee0d-8e15-4cf2-a537-29e11a006904 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:15.581049 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:15.590213 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3337da6-b45e-49aa-bf4a-16c2f4efaefc None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:15.628237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54ee0d-8e15-4cf2-a537-29e11a006904 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:15.634697 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ac8a5-8964-4632-8d12-b89941f3db71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:15.636074 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ac8a5-8964-4632-8d12-b89941f3db71 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:15.636609 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ac8a5-8964-4632-8d12-b89941f3db71 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:15.637075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ac8a5-8964-4632-8d12-b89941f3db71 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:15.638376 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ac8a5-8964-4632-8d12-b89941f3db71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:15.639500 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:15.641470 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ac8a5-8964-4632-8d12-b89941f3db71 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:15.670317 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 106/218] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:41:15 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:41:15.673292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7749b4-3d38-44e8-aaef-ddb2efaa68d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:15.673941 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7749b4-3d38-44e8-aaef-ddb2efaa68d0 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:15.674216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7749b4-3d38-44e8-aaef-ddb2efaa68d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:15.674484 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7749b4-3d38-44e8-aaef-ddb2efaa68d0 None admin] PATH_INFO: `/v3/users/d146a89560cd4147b7e21d3ad19ef0d4` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:15.692980 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7749b4-3d38-44e8-aaef-ddb2efaa68d0 None admin] RBAC: Authorizing `identity:get_user(user_id=d146a89560cd4147b7e21d3ad19ef0d4)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:15.694615 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7749b4-3d38-44e8-aaef-ddb2efaa68d0 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:15.697195 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 113/219] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:15 2022] GET /identity/v3/users/d146a89560cd4147b7e21d3ad19ef0d4 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:15.703577 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ac8a5-8964-4632-8d12-b89941f3db71 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:15.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7749b4-3d38-44e8-aaef-ddb2efaa68d0 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:15.849514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ac8a5-8964-4632-8d12-b89941f3db71 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:15.870723 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7749b4-3d38-44e8-aaef-ddb2efaa68d0 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:15.892235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff9553-ebb7-44c4-bc9b-270ab007e7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:15.892893 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9553-ebb7-44c4-bc9b-270ab007e7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:15.893175 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9553-ebb7-44c4-bc9b-270ab007e7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:15.893499 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9553-ebb7-44c4-bc9b-270ab007e7c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:15.909437 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421d72e-fd2f-4b22-9779-bb07bcc65dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:15.910389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d72e-fd2f-4b22-9779-bb07bcc65dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:15.910882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d72e-fd2f-4b22-9779-bb07bcc65dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:15.911313 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d72e-fd2f-4b22-9779-bb07bcc65dd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:15.916271 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:15.923815 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421d72e-fd2f-4b22-9779-bb07bcc65dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-e421d72e-fd2f-4b22-9779-bb07bcc65dd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:15.930025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:15.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:15.931720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:15.931720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:15.931720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:15.931720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:15.931720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:15.931720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:15.931720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:15.931720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:15.931720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:15.931720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:15.931720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:15.931720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:15.931720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 114/220] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:41:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:15.939987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421d72e-fd2f-4b22-9779-bb07bcc65dd0 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:15.982875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:15.987927 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff9553-ebb7-44c4-bc9b-270ab007e7c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:15.990605 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff9553-ebb7-44c4-bc9b-270ab007e7c4 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:16.077532 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421d72e-fd2f-4b22-9779-bb07bcc65dd0 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:16.120372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 107/221] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:16.126811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7afc49-6d6a-493e-8005-bd9174ed5153 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:16.126934 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da4965-0180-4d8c-86bb-38b588477fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:16.126934 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4965-0180-4d8c-86bb-38b588477fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:16.126934 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4965-0180-4d8c-86bb-38b588477fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:16.126934 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4965-0180-4d8c-86bb-38b588477fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:16.127205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da4965-0180-4d8c-86bb-38b588477fd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:16.127205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da4965-0180-4d8c-86bb-38b588477fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:16.127326 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7afc49-6d6a-493e-8005-bd9174ed5153 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:16.127326 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7afc49-6d6a-493e-8005-bd9174ed5153 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:16.127450 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da4965-0180-4d8c-86bb-38b588477fd2 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:16.128179 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 108/222] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:16.129609 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7afc49-6d6a-493e-8005-bd9174ed5153 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:16.143306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 115/223] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:16.144469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9da9e-b871-4f85-ae8c-2dc83205e775 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:16.149185 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9da9e-b871-4f85-ae8c-2dc83205e775 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:16.149483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9da9e-b871-4f85-ae8c-2dc83205e775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:16.175606 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-dad9da9e-b871-4f85-ae8c-2dc83205e775 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:16.177124 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-dad9da9e-b871-4f85-ae8c-2dc83205e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:16.190017 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:16.251235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7afc49-6d6a-493e-8005-bd9174ed5153 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:16.276677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 116/224] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:16.277923 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9da9e-b871-4f85-ae8c-2dc83205e775 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:16.292509 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9aebf-3fca-42c2-a662-1063f86c4617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:16.292746 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9aebf-3fca-42c2-a662-1063f86c4617 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:16.292919 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9aebf-3fca-42c2-a662-1063f86c4617 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:16.293332 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9aebf-3fca-42c2-a662-1063f86c4617 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:16.295551 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9aebf-3fca-42c2-a662-1063f86c4617 None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:16.296495 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9aebf-3fca-42c2-a662-1063f86c4617 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:16.298511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 109/225] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:16 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:16.304647 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9aebf-3fca-42c2-a662-1063f86c4617 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:16.313050 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:16.438616 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9da9e-b871-4f85-ae8c-2dc83205e775 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:16.459885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9aebf-3fca-42c2-a662-1063f86c4617 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:16.482813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:16.493339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc071656-2b91-48c5-af13-f3c04af321de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:16.493996 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071656-2b91-48c5-af13-f3c04af321de None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:16.494271 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071656-2b91-48c5-af13-f3c04af321de None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:16.494548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071656-2b91-48c5-af13-f3c04af321de None admin] PATH_INFO: `/v3/users/2c9a89aad5ed45668bd6ae876d9b6952` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:16.495732 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc071656-2b91-48c5-af13-f3c04af321de None admin] RBAC: Authorizing `identity:get_user(user_id=2c9a89aad5ed45668bd6ae876d9b6952)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:16.499216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc071656-2b91-48c5-af13-f3c04af321de None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:16.500895 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 117/226] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:16 2022] GET /identity/v3/users/2c9a89aad5ed45668bd6ae876d9b6952 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:16.506537 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746284bd-fd28-4d4b-8e41-10022424c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:16.506990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746284bd-fd28-4d4b-8e41-10022424c9db None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:16.507269 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746284bd-fd28-4d4b-8e41-10022424c9db None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:16.507542 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746284bd-fd28-4d4b-8e41-10022424c9db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:16.508274 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746284bd-fd28-4d4b-8e41-10022424c9db None admin] RBAC: Adding query filter params (role.id=eab9c0818aa3414eb3a1a155830ad262, scope.project.id=1c228a61fd2544379846b2c8a69fd2c3, user.id=d146a89560cd4147b7e21d3ad19ef0d4) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:16.508626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746284bd-fd28-4d4b-8e41-10022424c9db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:16.510057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746284bd-fd28-4d4b-8e41-10022424c9db None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:16.512523 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc071656-2b91-48c5-af13-f3c04af321de None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:16.519658 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 110/227] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:16 2022] GET /identity/v3/role_assignments?user.id=d146a89560cd4147b7e21d3ad19ef0d4&scope.project.id=1c228a61fd2544379846b2c8a69fd2c3&role.id=eab9c0818aa3414eb3a1a155830ad262 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:16.576153 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746284bd-fd28-4d4b-8e41-10022424c9db None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:16.636259 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:16.652459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc071656-2b91-48c5-af13-f3c04af321de None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:16.729630 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac28c3-d1c9-473c-a9ee-f9b48282df42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:16.730294 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac28c3-d1c9-473c-a9ee-f9b48282df42 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:16.730572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac28c3-d1c9-473c-a9ee-f9b48282df42 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:16.730846 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac28c3-d1c9-473c-a9ee-f9b48282df42 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:16.737500 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac28c3-d1c9-473c-a9ee-f9b48282df42 None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:16.739006 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac28c3-d1c9-473c-a9ee-f9b48282df42 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:16.740812 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 118/228] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:16 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:16.746576 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac28c3-d1c9-473c-a9ee-f9b48282df42 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:16.788608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746284bd-fd28-4d4b-8e41-10022424c9db None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:16.868510 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcda349-88e6-45a5-96ac-dc7126b03b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:16.869278 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcda349-88e6-45a5-96ac-dc7126b03b29 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:16.869488 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcda349-88e6-45a5-96ac-dc7126b03b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:16.869764 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcda349-88e6-45a5-96ac-dc7126b03b29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:16.893094 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcda349-88e6-45a5-96ac-dc7126b03b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-cfcda349-88e6-45a5-96ac-dc7126b03b29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:16.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:16.902075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:16.902848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:16.902848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:16.902848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:16.902848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:16.902848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:16.902848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:16.902848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:16.902848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:16.902848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:16.902848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:16.902848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:16.902848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:16.904586 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 111/229] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:41:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:16.909833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcda349-88e6-45a5-96ac-dc7126b03b29 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:16.947541 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac28c3-d1c9-473c-a9ee-f9b48282df42 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:16.989162 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:17.017102 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac850de-d3c4-413a-97a7-327c31e9b442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:17.017767 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac850de-d3c4-413a-97a7-327c31e9b442 None admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:17.018040 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac850de-d3c4-413a-97a7-327c31e9b442 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:17.018310 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac850de-d3c4-413a-97a7-327c31e9b442 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3/users/2c9a89aad5ed45668bd6ae876d9b6952/roles/a6d585feb70946b1b1ebcaece17d26b2` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:17.022175 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac850de-d3c4-413a-97a7-327c31e9b442 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c228a61fd2544379846b2c8a69fd2c3, user_id=2c9a89aad5ed45668bd6ae876d9b6952, role_id=a6d585feb70946b1b1ebcaece17d26b2)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:17.023646 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac850de-d3c4-413a-97a7-327c31e9b442 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:17.051955 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 119/230] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:41:16 2022] PUT /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3/users/2c9a89aad5ed45668bd6ae876d9b6952/roles/a6d585feb70946b1b1ebcaece17d26b2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:41:17.083113 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcda349-88e6-45a5-96ac-dc7126b03b29 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:17.132033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4a7db-0d22-47a6-b36f-8cecb6f80e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:17.133072 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4a7db-0d22-47a6-b36f-8cecb6f80e61 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:17.133618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4a7db-0d22-47a6-b36f-8cecb6f80e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:17.134117 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4a7db-0d22-47a6-b36f-8cecb6f80e61 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:17.135018 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4a7db-0d22-47a6-b36f-8cecb6f80e61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:17.135558 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4a7db-0d22-47a6-b36f-8cecb6f80e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:17.137394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4a7db-0d22-47a6-b36f-8cecb6f80e61 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:17.155821 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 112/231] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:17.162745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac850de-d3c4-413a-97a7-327c31e9b442 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:17.190368 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:17.284039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac850de-d3c4-413a-97a7-327c31e9b442 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:17.333411 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44122e2-c1a2-4e08-a9e0-5577ca690660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:17.333987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44122e2-c1a2-4e08-a9e0-5577ca690660 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:17.334265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44122e2-c1a2-4e08-a9e0-5577ca690660 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:17.334538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44122e2-c1a2-4e08-a9e0-5577ca690660 None admin] PATH_INFO: `/v3/users/2c9a89aad5ed45668bd6ae876d9b6952` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:17.349593 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44122e2-c1a2-4e08-a9e0-5577ca690660 None admin] RBAC: Authorizing `identity:get_user(user_id=2c9a89aad5ed45668bd6ae876d9b6952)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:17.351112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44122e2-c1a2-4e08-a9e0-5577ca690660 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:17.352894 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 120/232] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:17 2022] GET /identity/v3/users/2c9a89aad5ed45668bd6ae876d9b6952 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:17.359837 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4a7db-0d22-47a6-b36f-8cecb6f80e61 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:17.591041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4a7db-0d22-47a6-b36f-8cecb6f80e61 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:17.597575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:17.652769 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afbefd-0d76-48ec-814d-6014c6f0996a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:17.653688 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afbefd-0d76-48ec-814d-6014c6f0996a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:17.653978 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afbefd-0d76-48ec-814d-6014c6f0996a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:17.654255 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afbefd-0d76-48ec-814d-6014c6f0996a None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:17.656693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afbefd-0d76-48ec-814d-6014c6f0996a None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:17.658715 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afbefd-0d76-48ec-814d-6014c6f0996a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:17.660669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 113/233] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:17 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:17.670354 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44122e2-c1a2-4e08-a9e0-5577ca690660 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:17.830513 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:17.852288 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44122e2-c1a2-4e08-a9e0-5577ca690660 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:17.894924 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239faee-1ee9-4db5-a68b-32763144c69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:17.895929 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239faee-1ee9-4db5-a68b-32763144c69e None admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:17.896405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239faee-1ee9-4db5-a68b-32763144c69e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:17.896942 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239faee-1ee9-4db5-a68b-32763144c69e None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3/users/2c9a89aad5ed45668bd6ae876d9b6952/roles/3ebdb28c195f447294810f1033bb8e62` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:17.902302 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239faee-1ee9-4db5-a68b-32763144c69e None admin] RBAC: Authorizing `identity:create_grant(project_id=1c228a61fd2544379846b2c8a69fd2c3, user_id=2c9a89aad5ed45668bd6ae876d9b6952, role_id=3ebdb28c195f447294810f1033bb8e62)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:17.903964 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239faee-1ee9-4db5-a68b-32763144c69e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:17.926218 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 121/234] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:41:17 2022] PUT /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3/users/2c9a89aad5ed45668bd6ae876d9b6952/roles/3ebdb28c195f447294810f1033bb8e62 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:41:18.428369 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd034d4-c3d6-4bcf-8361-aa7996c30b44 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:18.428930 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd034d4-c3d6-4bcf-8361-aa7996c30b44 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:18.428930 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd034d4-c3d6-4bcf-8361-aa7996c30b44 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:18.430541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 114/235] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:18.435600 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b1865-91b3-4b67-b82b-b2808d8e019b None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:18.435985 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b1865-91b3-4b67-b82b-b2808d8e019b None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:18.436180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b1865-91b3-4b67-b82b-b2808d8e019b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:18.466559 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-431b1865-91b3-4b67-b82b-b2808d8e019b None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:18.467776 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-431b1865-91b3-4b67-b82b-b2808d8e019b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:18.566293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 122/236] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:18.701124 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd87cf-bf56-43cc-afca-0bebd94ceab7 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:18.701302 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd87cf-bf56-43cc-afca-0bebd94ceab7 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:18.701580 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd87cf-bf56-43cc-afca-0bebd94ceab7 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:18.703382 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 115/237] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:18.708299 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961170b-b332-4e0f-b403-d7d5187dbc37 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:18.708609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961170b-b332-4e0f-b403-d7d5187dbc37 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:18.708884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961170b-b332-4e0f-b403-d7d5187dbc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:18.733473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-9961170b-b332-4e0f-b403-d7d5187dbc37 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:18.735175 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-9961170b-b332-4e0f-b403-d7d5187dbc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:18.832498 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 123/238] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:18.908467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd87cf-bf56-43cc-afca-0bebd94ceab7 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:19.041313 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd87cf-bf56-43cc-afca-0bebd94ceab7 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:19.088072 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfded9-e662-4318-a1a0-4ff001ff44bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:19.088744 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfded9-e662-4318-a1a0-4ff001ff44bf None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:19.089028 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfded9-e662-4318-a1a0-4ff001ff44bf None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:19.089301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfded9-e662-4318-a1a0-4ff001ff44bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:19.102898 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfded9-e662-4318-a1a0-4ff001ff44bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-44dfded9-e662-4318-a1a0-4ff001ff44bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:19.107768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:19.108654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:19.109471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:19.109471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:19.109471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:19.109471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:19.109471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:19.109471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:19.109471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:19.109471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:19.109471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:19.109471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:19.109471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:19.109471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:19.109471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 116/239] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:19.117672 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961170b-b332-4e0f-b403-d7d5187dbc37 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:19.121265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:19.196969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfded9-e662-4318-a1a0-4ff001ff44bf None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:19.257988 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:19.293864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961170b-b332-4e0f-b403-d7d5187dbc37 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:19.341169 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec3e3a-dc98-49b9-b5d0-8ad0edb73de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:19.342253 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3e3a-dc98-49b9-b5d0-8ad0edb73de4 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:19.342506 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3e3a-dc98-49b9-b5d0-8ad0edb73de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:19.342777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3e3a-dc98-49b9-b5d0-8ad0edb73de4 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:19.343488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec3e3a-dc98-49b9-b5d0-8ad0edb73de4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:19.343789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec3e3a-dc98-49b9-b5d0-8ad0edb73de4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:19.345320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec3e3a-dc98-49b9-b5d0-8ad0edb73de4 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:19.354344 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 124/240] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:19.355355 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7124b-734e-4b7b-ba82-289d5b8a00f8 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:19.355636 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7124b-734e-4b7b-ba82-289d5b8a00f8 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:19.355909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7124b-734e-4b7b-ba82-289d5b8a00f8 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:19.356130 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfded9-e662-4318-a1a0-4ff001ff44bf None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:19.362241 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 125/241] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:19.363009 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7124b-734e-4b7b-ba82-289d5b8a00f8 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:19.399990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff7e4d-619b-4b09-a157-94ad309c759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:19.400714 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff7e4d-619b-4b09-a157-94ad309c759f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:19.400992 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff7e4d-619b-4b09-a157-94ad309c759f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:19.401316 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff7e4d-619b-4b09-a157-94ad309c759f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:19.402466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff7e4d-619b-4b09-a157-94ad309c759f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:19.404245 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff7e4d-619b-4b09-a157-94ad309c759f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:19.407629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 117/242] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:19.408817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c526ddd-149a-49c3-93ef-f85d1a225005 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:19.409098 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c526ddd-149a-49c3-93ef-f85d1a225005 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:19.409367 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c526ddd-149a-49c3-93ef-f85d1a225005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:19.430425 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-0c526ddd-149a-49c3-93ef-f85d1a225005 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:19.431610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-0c526ddd-149a-49c3-93ef-f85d1a225005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:19.444796 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:19.500279 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7124b-734e-4b7b-ba82-289d5b8a00f8 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:19.520804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 118/243] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:19.529567 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c526ddd-149a-49c3-93ef-f85d1a225005 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:19.539361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e838814-f8f2-4b81-8428-606919d28c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:19.548634 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e838814-f8f2-4b81-8428-606919d28c35 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:19.548634 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e838814-f8f2-4b81-8428-606919d28c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:19.548634 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e838814-f8f2-4b81-8428-606919d28c35 None admin] PATH_INFO: `/v3/users/af460eab01864812b85fa0a896dd446d` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:19.555783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e838814-f8f2-4b81-8428-606919d28c35 None admin] RBAC: Authorizing `identity:get_user(user_id=af460eab01864812b85fa0a896dd446d)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:19.557449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e838814-f8f2-4b81-8428-606919d28c35 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:19.559396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 126/244] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:19 2022] GET /identity/v3/users/af460eab01864812b85fa0a896dd446d => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:19.565159 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e838814-f8f2-4b81-8428-606919d28c35 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:19.588320 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:19.666999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c526ddd-149a-49c3-93ef-f85d1a225005 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:19.704117 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e838814-f8f2-4b81-8428-606919d28c35 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:19.730272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:19.742762 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50516b8-3759-4aa5-a057-8ef32c900ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:19.742992 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617545d-6d9f-424b-9811-3fb09d5fb221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:19.743765 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617545d-6d9f-424b-9811-3fb09d5fb221 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:19.743992 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50516b8-3759-4aa5-a057-8ef32c900ed3 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:19.744229 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617545d-6d9f-424b-9811-3fb09d5fb221 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:19.744587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50516b8-3759-4aa5-a057-8ef32c900ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:19.744693 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617545d-6d9f-424b-9811-3fb09d5fb221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:19.745082 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50516b8-3759-4aa5-a057-8ef32c900ed3 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:19.746024 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50516b8-3759-4aa5-a057-8ef32c900ed3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:19.747680 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50516b8-3759-4aa5-a057-8ef32c900ed3 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:19.792012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 119/245] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:41:19 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:41:19.886939 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617545d-6d9f-424b-9811-3fb09d5fb221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:19.888715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617545d-6d9f-424b-9811-3fb09d5fb221 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:19.909387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd165-bf74-423a-a201-c84be6acc789 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:19.910004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd165-bf74-423a-a201-c84be6acc789 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:19.910501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd165-bf74-423a-a201-c84be6acc789 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:19.912323 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 120/246] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:41:19.918057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e82a3-5e84-4014-8388-3b24aa9f1032 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:19.918632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e82a3-5e84-4014-8388-3b24aa9f1032 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:19.919116 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e82a3-5e84-4014-8388-3b24aa9f1032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:19.939760 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-7a2e82a3-5e84-4014-8388-3b24aa9f1032 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:19.941360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-7a2e82a3-5e84-4014-8388-3b24aa9f1032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:20.029815 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 121/247] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:20.036588 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e82a3-5e84-4014-8388-3b24aa9f1032 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:20.038423 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 127/248] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:41:20.045593 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617545d-6d9f-424b-9811-3fb09d5fb221 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:20.050025 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:20.077732 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:20.165631 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e82a3-5e84-4014-8388-3b24aa9f1032 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:20.185720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617545d-6d9f-424b-9811-3fb09d5fb221 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:20.219091 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05c3f8-1eb7-403a-a945-83c0a34822fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:20.220429 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05c3f8-1eb7-403a-a945-83c0a34822fd None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:20.220754 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05c3f8-1eb7-403a-a945-83c0a34822fd None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:20.221035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05c3f8-1eb7-403a-a945-83c0a34822fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:20.239434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05c3f8-1eb7-403a-a945-83c0a34822fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:20.239972 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedcaa0-576a-4d09-8ba3-e10552fcb3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:20.240655 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedcaa0-576a-4d09-8ba3-e10552fcb3dd None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:20.240933 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedcaa0-576a-4d09-8ba3-e10552fcb3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:20.241205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedcaa0-576a-4d09-8ba3-e10552fcb3dd None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:20.242349 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedcaa0-576a-4d09-8ba3-e10552fcb3dd None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:20.243957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedcaa0-576a-4d09-8ba3-e10552fcb3dd None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-fd05c3f8-1eb7-403a-a945-83c0a34822fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:20.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:20.245922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:20.246693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:20.246693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:20.246693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:20.246693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:20.246693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:20.246693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:20.246693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:20.246693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:20.246693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:20.246693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:20.246693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:20.246693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:20.246693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 122/250] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:20.251721 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 128/250] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:20 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:20.253512 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05c3f8-1eb7-403a-a945-83c0a34822fd None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:20.253791 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedcaa0-576a-4d09-8ba3-e10552fcb3dd None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:20.339478 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:20.366544 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:20.369937 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05c3f8-1eb7-403a-a945-83c0a34822fd None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:20.375827 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedcaa0-576a-4d09-8ba3-e10552fcb3dd None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:20.418062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792a70f-27de-4849-af24-9bdca60958f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:20.418783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792a70f-27de-4849-af24-9bdca60958f6 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:20.419065 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792a70f-27de-4849-af24-9bdca60958f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:20.419336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792a70f-27de-4849-af24-9bdca60958f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:20.419587 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa83577-e8de-470c-bfdb-670519cbc4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:20.420060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792a70f-27de-4849-af24-9bdca60958f6 None admin] RBAC: Adding query filter params (role.id=8fcc3c7d309e469fad57a0bb086976fd, scope.project.id=1c228a61fd2544379846b2c8a69fd2c3, user.id=af460eab01864812b85fa0a896dd446d) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:20.420363 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792a70f-27de-4849-af24-9bdca60958f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:20.420771 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa83577-e8de-470c-bfdb-670519cbc4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:20.421219 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa83577-e8de-470c-bfdb-670519cbc4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:20.422201 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa83577-e8de-470c-bfdb-670519cbc4e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:20.422469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792a70f-27de-4849-af24-9bdca60958f6 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:20.423239 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa83577-e8de-470c-bfdb-670519cbc4e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:20.423708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa83577-e8de-470c-bfdb-670519cbc4e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:20.425865 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa83577-e8de-470c-bfdb-670519cbc4e8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:20.432223 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 123/251] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:20 2022] GET /identity/v3/role_assignments?user.id=af460eab01864812b85fa0a896dd446d&scope.project.id=1c228a61fd2544379846b2c8a69fd2c3&role.id=8fcc3c7d309e469fad57a0bb086976fd => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:20.432923 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792a70f-27de-4849-af24-9bdca60958f6 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:20.436454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 129/252] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:20.443200 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa83577-e8de-470c-bfdb-670519cbc4e8 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:20.599889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792a70f-27de-4849-af24-9bdca60958f6 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:20.614660 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa83577-e8de-470c-bfdb-670519cbc4e8 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:20.677371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1dfe8-672e-4e58-ba42-a215e6705683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:20.679367 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1dfe8-672e-4e58-ba42-a215e6705683 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:20.679869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1dfe8-672e-4e58-ba42-a215e6705683 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:20.680853 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1dfe8-672e-4e58-ba42-a215e6705683 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:20.684794 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792fab4-1fc9-4953-aea8-2ee3577079af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:20.685810 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792fab4-1fc9-4953-aea8-2ee3577079af None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:20.687460 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792fab4-1fc9-4953-aea8-2ee3577079af None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:20.688032 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792fab4-1fc9-4953-aea8-2ee3577079af None admin] PATH_INFO: `/v3/users/d146a89560cd4147b7e21d3ad19ef0d4` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:20.691355 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792fab4-1fc9-4953-aea8-2ee3577079af None admin] RBAC: Authorizing `identity:get_user(user_id=d146a89560cd4147b7e21d3ad19ef0d4)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:20.694265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792fab4-1fc9-4953-aea8-2ee3577079af None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:20.703321 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 130/253] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:20 2022] GET /identity/v3/users/d146a89560cd4147b7e21d3ad19ef0d4 => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:20.705163 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:20.712584 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792fab4-1fc9-4953-aea8-2ee3577079af None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:20.724367 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1dfe8-672e-4e58-ba42-a215e6705683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-2ca1dfe8-672e-4e58-ba42-a215e6705683 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:20.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:20.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:20.735804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:20.735804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:20.735804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:20.735804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:20.735804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:20.735804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:20.735804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:20.735804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:20.735804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:20.735804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:20.735804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:20.735804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:20.738378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 124/254] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:41:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:20.750077 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1dfe8-672e-4e58-ba42-a215e6705683 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:20.777131 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:20.895983 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792fab4-1fc9-4953-aea8-2ee3577079af None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:20.934620 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53945293-5cda-4943-b161-c402d1c9e533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:20.935257 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53945293-5cda-4943-b161-c402d1c9e533 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:20.935534 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53945293-5cda-4943-b161-c402d1c9e533 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:20.936343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53945293-5cda-4943-b161-c402d1c9e533 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:20.937564 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53945293-5cda-4943-b161-c402d1c9e533 None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:20.939179 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53945293-5cda-4943-b161-c402d1c9e533 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:20.941376 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 131/255] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:20 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:20.942791 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014da83f-8eca-4cf9-a67a-17383d8f5842 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:20.943070 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014da83f-8eca-4cf9-a67a-17383d8f5842 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:20.943346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014da83f-8eca-4cf9-a67a-17383d8f5842 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:20.949999 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 132/256] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:20.950875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014da83f-8eca-4cf9-a67a-17383d8f5842 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:20.978448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1dfe8-672e-4e58-ba42-a215e6705683 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:21.033212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88935214-6ffc-4605-8780-cff816dab318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:21.033826 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935214-6ffc-4605-8780-cff816dab318 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:21.034107 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935214-6ffc-4605-8780-cff816dab318 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:21.034380 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935214-6ffc-4605-8780-cff816dab318 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:21.035046 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88935214-6ffc-4605-8780-cff816dab318 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:21.035361 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88935214-6ffc-4605-8780-cff816dab318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:21.037766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88935214-6ffc-4605-8780-cff816dab318 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:21.050863 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 125/257] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:21.052099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8415fcc-a730-45be-a00e-81d01bbcb8f5 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:21.052385 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8415fcc-a730-45be-a00e-81d01bbcb8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:21.052684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8415fcc-a730-45be-a00e-81d01bbcb8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:21.095546 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-d8415fcc-a730-45be-a00e-81d01bbcb8f5 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:21.099059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-d8415fcc-a730-45be-a00e-81d01bbcb8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:21.114338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:21.154286 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014da83f-8eca-4cf9-a67a-17383d8f5842 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:21.168928 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:21.194821 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 126/258] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:21.197941 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8415fcc-a730-45be-a00e-81d01bbcb8f5 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:21.211129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96f8b1-7000-48b2-b50f-78471f20df29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:21.212036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96f8b1-7000-48b2-b50f-78471f20df29 None admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:21.212453 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96f8b1-7000-48b2-b50f-78471f20df29 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:21.212888 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96f8b1-7000-48b2-b50f-78471f20df29 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3/users/d146a89560cd4147b7e21d3ad19ef0d4/roles/eab9c0818aa3414eb3a1a155830ad262` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:21.215709 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96f8b1-7000-48b2-b50f-78471f20df29 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c228a61fd2544379846b2c8a69fd2c3, user_id=d146a89560cd4147b7e21d3ad19ef0d4, role_id=eab9c0818aa3414eb3a1a155830ad262)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:21.218223 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96f8b1-7000-48b2-b50f-78471f20df29 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:21.241934 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 133/259] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:41:20 2022] PUT /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3/users/d146a89560cd4147b7e21d3ad19ef0d4/roles/eab9c0818aa3414eb3a1a155830ad262 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:41:21.349473 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8415fcc-a730-45be-a00e-81d01bbcb8f5 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:21.397218 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d1d73-e480-453c-834c-f3802079dfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:21.398105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1d73-e480-453c-834c-f3802079dfe3 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:21.398557 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1d73-e480-453c-834c-f3802079dfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:21.398968 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1d73-e480-453c-834c-f3802079dfe3 None admin] PATH_INFO: `/v3/users/2c9a89aad5ed45668bd6ae876d9b6952` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:21.400288 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d1d73-e480-453c-834c-f3802079dfe3 None admin] RBAC: Authorizing `identity:get_user(user_id=2c9a89aad5ed45668bd6ae876d9b6952)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:21.401904 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d1d73-e480-453c-834c-f3802079dfe3 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:21.403611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 127/260] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:21 2022] GET /identity/v3/users/2c9a89aad5ed45668bd6ae876d9b6952 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:21.409461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96f8b1-7000-48b2-b50f-78471f20df29 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:21.530878 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96f8b1-7000-48b2-b50f-78471f20df29 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:21.569009 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c4b4-e11d-4758-8855-d4c0932a8a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:21.569863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c4b4-e11d-4758-8855-d4c0932a8a10 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:21.570282 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c4b4-e11d-4758-8855-d4c0932a8a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:21.570791 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c4b4-e11d-4758-8855-d4c0932a8a10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:21.592583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:21.656532 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34c4b4-e11d-4758-8855-d4c0932a8a10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:21.658717 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34c4b4-e11d-4758-8855-d4c0932a8a10 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:21.708357 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d1d73-e480-453c-834c-f3802079dfe3 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:21.766497 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 134/261] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:41:21.777077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c4b4-e11d-4758-8855-d4c0932a8a10 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:21.817473 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:21.847721 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:21.863860 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d1d73-e480-453c-834c-f3802079dfe3 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:21.918368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6212b-d893-4a68-ac14-56e2c42c0510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:21.919011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6212b-d893-4a68-ac14-56e2c42c0510 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:21.919290 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6212b-d893-4a68-ac14-56e2c42c0510 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:21.919562 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6212b-d893-4a68-ac14-56e2c42c0510 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:21.934057 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c4b4-e11d-4758-8855-d4c0932a8a10 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:21.939950 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6212b-d893-4a68-ac14-56e2c42c0510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-e5e6212b-d893-4a68-ac14-56e2c42c0510 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:21.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:21.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:21.946516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:21.946516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:21.946516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:21.946516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:21.946516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:21.946516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:21.946516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:21.946516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:21.946516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:21.946516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:21.946516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:21.946516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:21.951454 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 128/262] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:41:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:41:21.952274 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6212b-d893-4a68-ac14-56e2c42c0510 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:22.001483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36f36b-1990-4214-af67-59cbc21f6566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:22.002563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36f36b-1990-4214-af67-59cbc21f6566 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:22.003038 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36f36b-1990-4214-af67-59cbc21f6566 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:22.003503 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36f36b-1990-4214-af67-59cbc21f6566 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:22.006808 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36f36b-1990-4214-af67-59cbc21f6566 None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:22.008738 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36f36b-1990-4214-af67-59cbc21f6566 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:22.011021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 135/263] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:21 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:22.030302 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36f36b-1990-4214-af67-59cbc21f6566 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:22.112013 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6212b-d893-4a68-ac14-56e2c42c0510 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:22.151469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36f36b-1990-4214-af67-59cbc21f6566 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:22.152441 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:22.182464 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:22.186975 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cb85f-4289-4b49-a067-d28668647270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:22.188272 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cb85f-4289-4b49-a067-d28668647270 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:22.188668 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cb85f-4289-4b49-a067-d28668647270 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:22.188895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cb85f-4289-4b49-a067-d28668647270 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:22.189506 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cb85f-4289-4b49-a067-d28668647270 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:22.190691 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cb85f-4289-4b49-a067-d28668647270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:22.191179 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cb85f-4289-4b49-a067-d28668647270 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:22.211469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 129/264] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:22.219151 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8271e1c-31be-430e-af0f-d0fea6f80f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:22.219772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8271e1c-31be-430e-af0f-d0fea6f80f04 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:22.220050 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8271e1c-31be-430e-af0f-d0fea6f80f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:22.220324 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8271e1c-31be-430e-af0f-d0fea6f80f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:22.221081 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8271e1c-31be-430e-af0f-d0fea6f80f04 None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=1c228a61fd2544379846b2c8a69fd2c3, user.id=2c9a89aad5ed45668bd6ae876d9b6952) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:22.221383 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8271e1c-31be-430e-af0f-d0fea6f80f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:22.222834 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8271e1c-31be-430e-af0f-d0fea6f80f04 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:22.226073 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cb85f-4289-4b49-a067-d28668647270 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:22.242563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 136/265] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:22 2022] GET /identity/v3/role_assignments?user.id=2c9a89aad5ed45668bd6ae876d9b6952&scope.project.id=1c228a61fd2544379846b2c8a69fd2c3&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:22.342104 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cb85f-4289-4b49-a067-d28668647270 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:22.378936 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fc56e-6fae-4415-a56b-d189958093df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:22.379592 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fc56e-6fae-4415-a56b-d189958093df None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:22.379874 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fc56e-6fae-4415-a56b-d189958093df None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:22.380147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fc56e-6fae-4415-a56b-d189958093df None admin] PATH_INFO: `/v3/users/2c9a89aad5ed45668bd6ae876d9b6952` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:22.381406 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fc56e-6fae-4415-a56b-d189958093df None admin] RBAC: Authorizing `identity:get_user(user_id=2c9a89aad5ed45668bd6ae876d9b6952)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:22.382876 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fc56e-6fae-4415-a56b-d189958093df None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:22.384803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 130/266] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:22 2022] GET /identity/v3/users/2c9a89aad5ed45668bd6ae876d9b6952 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:22.390900 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8271e1c-31be-430e-af0f-d0fea6f80f04 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:22.501167 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8271e1c-31be-430e-af0f-d0fea6f80f04 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:22.537516 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41095e2-2a43-4bd1-9927-b238674125ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:22.538232 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41095e2-2a43-4bd1-9927-b238674125ce None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:22.538514 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41095e2-2a43-4bd1-9927-b238674125ce None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:22.538796 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41095e2-2a43-4bd1-9927-b238674125ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:22.594088 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:22.618724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41095e2-2a43-4bd1-9927-b238674125ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:22.620208 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41095e2-2a43-4bd1-9927-b238674125ce None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:22.737518 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 137/267] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:22.743110 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fc56e-6fae-4415-a56b-d189958093df None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:22.806904 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:22.863039 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fc56e-6fae-4415-a56b-d189958093df None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:22.899691 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627fcc5-9954-4b04-9c64-b0fc663a7479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:22.900399 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627fcc5-9954-4b04-9c64-b0fc663a7479 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:22.900717 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627fcc5-9954-4b04-9c64-b0fc663a7479 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:22.900997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627fcc5-9954-4b04-9c64-b0fc663a7479 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:22.902158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627fcc5-9954-4b04-9c64-b0fc663a7479 None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:22.903606 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627fcc5-9954-4b04-9c64-b0fc663a7479 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:22.905584 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 131/268] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:22 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:22.911569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41095e2-2a43-4bd1-9927-b238674125ce None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:23.006964 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:23.026881 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41095e2-2a43-4bd1-9927-b238674125ce None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:23.067844 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa7e59-e6e4-4577-b522-bc8be0947164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:23.068479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa7e59-e6e4-4577-b522-bc8be0947164 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:23.068829 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa7e59-e6e4-4577-b522-bc8be0947164 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:23.069107 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa7e59-e6e4-4577-b522-bc8be0947164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:23.069954 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa7e59-e6e4-4577-b522-bc8be0947164 None admin] RBAC: Adding query filter params (role.id=3ebdb28c195f447294810f1033bb8e62, scope.project.id=1c228a61fd2544379846b2c8a69fd2c3, user.id=2c9a89aad5ed45668bd6ae876d9b6952) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:23.070273 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa7e59-e6e4-4577-b522-bc8be0947164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:23.071809 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa7e59-e6e4-4577-b522-bc8be0947164 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:23.081439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 138/269] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:22 2022] GET /identity/v3/role_assignments?user.id=2c9a89aad5ed45668bd6ae876d9b6952&scope.project.id=1c228a61fd2544379846b2c8a69fd2c3&role.id=3ebdb28c195f447294810f1033bb8e62 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:23.203671 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f318b2a-2af8-414a-b36f-a11bc2b3d863 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:23.203944 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f318b2a-2af8-414a-b36f-a11bc2b3d863 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:23.204260 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f318b2a-2af8-414a-b36f-a11bc2b3d863 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:23.205969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 132/270] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:23.211956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95012bd3-a91e-46f4-87a4-67746bfa1744 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:23.212237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95012bd3-a91e-46f4-87a4-67746bfa1744 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:23.212510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95012bd3-a91e-46f4-87a4-67746bfa1744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:23.238435 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-95012bd3-a91e-46f4-87a4-67746bfa1744 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:23.239652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-95012bd3-a91e-46f4-87a4-67746bfa1744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:23.286319 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d1186-b18e-4e39-95af-423e4ad839cf None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:23.286625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d1186-b18e-4e39-95af-423e4ad839cf None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:23.286879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d1186-b18e-4e39-95af-423e4ad839cf None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:23.288656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 133/271] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:23.295005 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7406e-fb5e-4069-948b-966249ae041a None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:23.295335 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7406e-fb5e-4069-948b-966249ae041a None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:23.295677 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7406e-fb5e-4069-948b-966249ae041a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:23.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-56b7406e-fb5e-4069-948b-966249ae041a None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:23.328111 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-56b7406e-fb5e-4069-948b-966249ae041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:23.345364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 139/272] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:23.406709 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 134/273] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:23.635723 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95012bd3-a91e-46f4-87a4-67746bfa1744 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:23.665544 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b5cb3-fdc7-49a9-9ac3-c8d7ce84cefa None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:23.666181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b5cb3-fdc7-49a9-9ac3-c8d7ce84cefa None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:23.666651 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b5cb3-fdc7-49a9-9ac3-c8d7ce84cefa None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:23.668408 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 135/274] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:23.674704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bfac5-254d-43c8-9b48-e5119d3a588c None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:23.675225 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bfac5-254d-43c8-9b48-e5119d3a588c None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:23.675693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bfac5-254d-43c8-9b48-e5119d3a588c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:23.698546 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-ac2bfac5-254d-43c8-9b48-e5119d3a588c None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:23.700164 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-ac2bfac5-254d-43c8-9b48-e5119d3a588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:23.729733 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:23.753458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:23.756519 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95012bd3-a91e-46f4-87a4-67746bfa1744 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:23.778610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 136/275] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:23.779445 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bfac5-254d-43c8-9b48-e5119d3a588c None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:23.797496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f77d4a-75e4-44a4-8896-0ac4425e9031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:23.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77d4a-75e4-44a4-8896-0ac4425e9031 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:23.798309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77d4a-75e4-44a4-8896-0ac4425e9031 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:23.798580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77d4a-75e4-44a4-8896-0ac4425e9031 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:23.799684 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f77d4a-75e4-44a4-8896-0ac4425e9031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:23.801260 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f77d4a-75e4-44a4-8896-0ac4425e9031 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:23.807311 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 140/276] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:23.808229 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f77d4a-75e4-44a4-8896-0ac4425e9031 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:23.899178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bfac5-254d-43c8-9b48-e5119d3a588c None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:23.931962 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f77d4a-75e4-44a4-8896-0ac4425e9031 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:23.942054 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde50a66-f6d5-4839-8de0-85bb370974fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:23.943258 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde50a66-f6d5-4839-8de0-85bb370974fa None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:23.943690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde50a66-f6d5-4839-8de0-85bb370974fa None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:23.944253 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde50a66-f6d5-4839-8de0-85bb370974fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:23.959233 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde50a66-f6d5-4839-8de0-85bb370974fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-dde50a66-f6d5-4839-8de0-85bb370974fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:23.966343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:23.967339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:23.968137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:23.968137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:23.968137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:23.968137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:23.968137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:23.968137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:23.968137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:23.968137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:23.968137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:23.968137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:23.968137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:23.968137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:23.972925 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 137/277] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:23.973870 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde50a66-f6d5-4839-8de0-85bb370974fa None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:23.974686 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a21226-e890-4657-ab6a-53a849026536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:23.975518 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a21226-e890-4657-ab6a-53a849026536 None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:23.976030 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a21226-e890-4657-ab6a-53a849026536 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:23.976487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a21226-e890-4657-ab6a-53a849026536 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:23.977447 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a21226-e890-4657-ab6a-53a849026536 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:23.979157 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a21226-e890-4657-ab6a-53a849026536 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:23.999022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:24.013026 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 141/278] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:41:23 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:41:24.046865 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:24.063814 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a21226-e890-4657-ab6a-53a849026536 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:24.105167 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde50a66-f6d5-4839-8de0-85bb370974fa None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:24.145957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335420dd-4883-40aa-bbcd-81e0a9c24aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:24.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335420dd-4883-40aa-bbcd-81e0a9c24aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:24.146954 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335420dd-4883-40aa-bbcd-81e0a9c24aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:24.147225 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335420dd-4883-40aa-bbcd-81e0a9c24aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:24.147897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335420dd-4883-40aa-bbcd-81e0a9c24aa6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:24.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335420dd-4883-40aa-bbcd-81e0a9c24aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:24.149694 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335420dd-4883-40aa-bbcd-81e0a9c24aa6 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:24.160879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 138/279] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:24.166043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335420dd-4883-40aa-bbcd-81e0a9c24aa6 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:24.208783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a21226-e890-4657-ab6a-53a849026536 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:24.253764 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b330d8-db81-4e6e-9c02-f81b8d014200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:24.254470 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b330d8-db81-4e6e-9c02-f81b8d014200 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:24.254757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b330d8-db81-4e6e-9c02-f81b8d014200 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:24.255029 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b330d8-db81-4e6e-9c02-f81b8d014200 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:24.268246 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b330d8-db81-4e6e-9c02-f81b8d014200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-30b330d8-db81-4e6e-9c02-f81b8d014200 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:24.274666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:24.275512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:24.276777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:24.276777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:24.276777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:24.276777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:24.276777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:24.276777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:24.276777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:24.276777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:24.276777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:24.276777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:24.276777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:24.276777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:24.276777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 142/280] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:41:24.281642 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b330d8-db81-4e6e-9c02-f81b8d014200 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:24.289765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:24.293709 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335420dd-4883-40aa-bbcd-81e0a9c24aa6 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:24.350918 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422c831-c577-4274-a2b4-05854239d516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:24.351665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422c831-c577-4274-a2b4-05854239d516 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:24.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422c831-c577-4274-a2b4-05854239d516 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:24.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422c831-c577-4274-a2b4-05854239d516 None admin] PATH_INFO: `/v3/users/f8ec05240e8b4f82b193d9382e382240` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:24.361819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:24.369306 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422c831-c577-4274-a2b4-05854239d516 None admin] RBAC: Authorizing `identity:get_user(user_id=f8ec05240e8b4f82b193d9382e382240)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:24.370832 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422c831-c577-4274-a2b4-05854239d516 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:24.372836 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 139/281] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:24 2022] GET /identity/v3/users/f8ec05240e8b4f82b193d9382e382240 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:24.378729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422c831-c577-4274-a2b4-05854239d516 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:24.427631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b330d8-db81-4e6e-9c02-f81b8d014200 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:24.477350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e7bd5-92c1-41ae-baff-d6d551d6f9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:24.478039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e7bd5-92c1-41ae-baff-d6d551d6f9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:24.478325 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e7bd5-92c1-41ae-baff-d6d551d6f9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:24.478784 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e7bd5-92c1-41ae-baff-d6d551d6f9e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:24.479488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e7bd5-92c1-41ae-baff-d6d551d6f9e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:24.479800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e7bd5-92c1-41ae-baff-d6d551d6f9e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:24.481331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e7bd5-92c1-41ae-baff-d6d551d6f9e3 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:24.498912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 143/282] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:24.506133 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e7bd5-92c1-41ae-baff-d6d551d6f9e3 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:24.527504 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422c831-c577-4274-a2b4-05854239d516 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:24.568032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719fd0c-fc6b-46d0-b8fc-7f4889173fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:24.569014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719fd0c-fc6b-46d0-b8fc-7f4889173fcf None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:24.569510 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719fd0c-fc6b-46d0-b8fc-7f4889173fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:24.569976 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719fd0c-fc6b-46d0-b8fc-7f4889173fcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:24.570909 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719fd0c-fc6b-46d0-b8fc-7f4889173fcf None admin] RBAC: Adding query filter params (role.id=eab9c0818aa3414eb3a1a155830ad262, user.id=f8ec05240e8b4f82b193d9382e382240, scope.system=all) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:24.571409 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719fd0c-fc6b-46d0-b8fc-7f4889173fcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:24.573523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719fd0c-fc6b-46d0-b8fc-7f4889173fcf None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:24.581256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 140/283] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Sep 25 00:41:24 2022] GET /identity/v3/role_assignments?user.id=f8ec05240e8b4f82b193d9382e382240&scope.system=all&role.id=eab9c0818aa3414eb3a1a155830ad262 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:24.631282 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3586b5-0bac-41aa-91c0-82300f9eeb1e None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:24.631986 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3586b5-0bac-41aa-91c0-82300f9eeb1e None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:24.632454 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3586b5-0bac-41aa-91c0-82300f9eeb1e None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:24.634142 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 141/284] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:24.639629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed43785-cfda-4962-9e4c-af93dfe07c05 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:24.640241 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed43785-cfda-4962-9e4c-af93dfe07c05 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:24.640732 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed43785-cfda-4962-9e4c-af93dfe07c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:24.650731 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e7bd5-92c1-41ae-baff-d6d551d6f9e3 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:24.674259 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-1ed43785-cfda-4962-9e4c-af93dfe07c05 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:24.675821 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-1ed43785-cfda-4962-9e4c-af93dfe07c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:24.708724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:24.719208 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:24.745356 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7af049-dc81-48cd-bc25-e41e0ae67880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:24.749172 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af049-dc81-48cd-bc25-e41e0ae67880 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:24.750307 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af049-dc81-48cd-bc25-e41e0ae67880 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:24.750780 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af049-dc81-48cd-bc25-e41e0ae67880 None admin] PATH_INFO: `/v3/users/af460eab01864812b85fa0a896dd446d` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:24.755050 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7af049-dc81-48cd-bc25-e41e0ae67880 None admin] RBAC: Authorizing `identity:get_user(user_id=af460eab01864812b85fa0a896dd446d)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:24.756973 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7af049-dc81-48cd-bc25-e41e0ae67880 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:24.761894 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 144/285] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:24 2022] GET /identity/v3/users/af460eab01864812b85fa0a896dd446d => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:24.769859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7af049-dc81-48cd-bc25-e41e0ae67880 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:24.802953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 142/286] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:24.892253 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7af049-dc81-48cd-bc25-e41e0ae67880 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:24.928390 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a544b59-a219-4a74-958b-6fe753d3c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:24.929383 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a544b59-a219-4a74-958b-6fe753d3c101 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:24.929855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a544b59-a219-4a74-958b-6fe753d3c101 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:24.930362 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a544b59-a219-4a74-958b-6fe753d3c101 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:24.931693 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a544b59-a219-4a74-958b-6fe753d3c101 None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:24.933371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a544b59-a219-4a74-958b-6fe753d3c101 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:24.935543 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 145/287] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:24 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:24.941084 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed43785-cfda-4962-9e4c-af93dfe07c05 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:25.051523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed43785-cfda-4962-9e4c-af93dfe07c05 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:25.086146 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db6801-099a-44d6-93da-b48062e43b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:25.087245 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db6801-099a-44d6-93da-b48062e43b1d None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:25.087716 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db6801-099a-44d6-93da-b48062e43b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:25.088225 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db6801-099a-44d6-93da-b48062e43b1d None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3/users/af460eab01864812b85fa0a896dd446d/roles/8fcc3c7d309e469fad57a0bb086976fd` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:25.090344 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db6801-099a-44d6-93da-b48062e43b1d None admin] RBAC: Authorizing `identity:create_grant(project_id=1c228a61fd2544379846b2c8a69fd2c3, user_id=af460eab01864812b85fa0a896dd446d, role_id=8fcc3c7d309e469fad57a0bb086976fd)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:25.092013 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db6801-099a-44d6-93da-b48062e43b1d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:25.107808 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 143/288] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:41:24 2022] PUT /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3/users/af460eab01864812b85fa0a896dd446d/roles/8fcc3c7d309e469fad57a0bb086976fd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:41:25.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a544b59-a219-4a74-958b-6fe753d3c101 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:25.191192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:25.239094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a544b59-a219-4a74-958b-6fe753d3c101 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:25.284032 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bbc54-466c-4ccd-86b3-c706043ac29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:25.288977 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bbc54-466c-4ccd-86b3-c706043ac29e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:25.289323 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bbc54-466c-4ccd-86b3-c706043ac29e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:25.289602 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bbc54-466c-4ccd-86b3-c706043ac29e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:25.302414 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bbc54-466c-4ccd-86b3-c706043ac29e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-d65bbc54-466c-4ccd-86b3-c706043ac29e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:25.307957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:25.308913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:25.309772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:25.309772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:25.309772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:25.309772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:25.309772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:25.309772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:25.309772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:25.309772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:25.309772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:25.309772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:25.309772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:25.309772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:25.309772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 146/289] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:25.317092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db6801-099a-44d6-93da-b48062e43b1d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:25.336501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:25.427252 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db6801-099a-44d6-93da-b48062e43b1d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:25.461495 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042659d6-30fb-4a98-a83f-d72b0046b43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:25.462161 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042659d6-30fb-4a98-a83f-d72b0046b43f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:25.462443 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042659d6-30fb-4a98-a83f-d72b0046b43f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:25.462717 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042659d6-30fb-4a98-a83f-d72b0046b43f None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:25.463379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042659d6-30fb-4a98-a83f-d72b0046b43f None admin] RBAC: Adding query filter params (name=member) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:25.463678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042659d6-30fb-4a98-a83f-d72b0046b43f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:25.465089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042659d6-30fb-4a98-a83f-d72b0046b43f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:25.478718 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 144/290] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:25.480210 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bbc54-466c-4ccd-86b3-c706043ac29e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:25.590969 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bbc54-466c-4ccd-86b3-c706043ac29e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:25.608935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:25.627469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41b0e0-dd1d-4862-bdd8-44229f883125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:25.628136 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41b0e0-dd1d-4862-bdd8-44229f883125 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:25.632572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41b0e0-dd1d-4862-bdd8-44229f883125 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:25.632572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41b0e0-dd1d-4862-bdd8-44229f883125 None admin] PATH_INFO: `/v3/users/d146a89560cd4147b7e21d3ad19ef0d4` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:25.632572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41b0e0-dd1d-4862-bdd8-44229f883125 None admin] RBAC: Authorizing `identity:get_user(user_id=d146a89560cd4147b7e21d3ad19ef0d4)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:25.633045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41b0e0-dd1d-4862-bdd8-44229f883125 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:25.634650 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 147/291] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:25 2022] GET /identity/v3/users/d146a89560cd4147b7e21d3ad19ef0d4 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:25.641021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042659d6-30fb-4a98-a83f-d72b0046b43f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:25.720965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:25.743466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042659d6-30fb-4a98-a83f-d72b0046b43f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:25.778489 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bea9c-8a41-4e99-b4bb-25c8577e7f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:25.779126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bea9c-8a41-4e99-b4bb-25c8577e7f06 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:25.779473 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bea9c-8a41-4e99-b4bb-25c8577e7f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:25.779754 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bea9c-8a41-4e99-b4bb-25c8577e7f06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:25.852432 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bea9c-8a41-4e99-b4bb-25c8577e7f06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:25.853835 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bea9c-8a41-4e99-b4bb-25c8577e7f06 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:25.945852 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:25.963290 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 145/292] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:25.964654 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41b0e0-dd1d-4862-bdd8-44229f883125 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:26.073736 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41b0e0-dd1d-4862-bdd8-44229f883125 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:26.117649 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0757b9-0045-453b-931b-89d6ad5adaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:26.118208 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0757b9-0045-453b-931b-89d6ad5adaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:26.118485 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0757b9-0045-453b-931b-89d6ad5adaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:26.118755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0757b9-0045-453b-931b-89d6ad5adaf5 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:26.119867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0757b9-0045-453b-931b-89d6ad5adaf5 None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:26.121342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0757b9-0045-453b-931b-89d6ad5adaf5 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:26.122963 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 148/293] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:25 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:26.129628 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bea9c-8a41-4e99-b4bb-25c8577e7f06 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:26.237529 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bea9c-8a41-4e99-b4bb-25c8577e7f06 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:26.272767 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ea9ca-a831-4f01-b8fe-1ce61a1852a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:26.273372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ea9ca-a831-4f01-b8fe-1ce61a1852a4 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:26.273651 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ea9ca-a831-4f01-b8fe-1ce61a1852a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:26.273923 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ea9ca-a831-4f01-b8fe-1ce61a1852a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:26.274643 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ea9ca-a831-4f01-b8fe-1ce61a1852a4 None admin] RBAC: Adding query filter params (role.id=eab9c0818aa3414eb3a1a155830ad262, scope.project.id=1c228a61fd2544379846b2c8a69fd2c3, user.id=d146a89560cd4147b7e21d3ad19ef0d4) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:26.274957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ea9ca-a831-4f01-b8fe-1ce61a1852a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:26.276390 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ea9ca-a831-4f01-b8fe-1ce61a1852a4 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:26.288689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 146/294] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:26 2022] GET /identity/v3/role_assignments?user.id=d146a89560cd4147b7e21d3ad19ef0d4&scope.project.id=1c228a61fd2544379846b2c8a69fd2c3&role.id=eab9c0818aa3414eb3a1a155830ad262 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:26.818300 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19ced9-4a05-43c5-b4c0-cac88edcef5d None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:26.818577 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19ced9-4a05-43c5-b4c0-cac88edcef5d None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:26.819122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19ced9-4a05-43c5-b4c0-cac88edcef5d None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:26.820956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 149/295] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:26.828425 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e05ce-0aaa-4f61-8a4d-d35e91b3e200 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:26.828984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e05ce-0aaa-4f61-8a4d-d35e91b3e200 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:26.829470 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e05ce-0aaa-4f61-8a4d-d35e91b3e200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:26.849213 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-772e05ce-0aaa-4f61-8a4d-d35e91b3e200 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:26.850699 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-772e05ce-0aaa-4f61-8a4d-d35e91b3e200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:26.880468 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:26.927649 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 147/296] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:27.020853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b14efb-1581-4829-9bcf-d5d3140b5305 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:27.021370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b14efb-1581-4829-9bcf-d5d3140b5305 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:27.021370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b14efb-1581-4829-9bcf-d5d3140b5305 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:27.023039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 150/297] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:27.028000 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6ab5-2d76-407c-8d46-277173cde6ff None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:27.028290 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6ab5-2d76-407c-8d46-277173cde6ff None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:27.028581 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6ab5-2d76-407c-8d46-277173cde6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:27.047074 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-178e6ab5-2d76-407c-8d46-277173cde6ff None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:27.048260 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-178e6ab5-2d76-407c-8d46-277173cde6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:27.125484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 148/298] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:27.191550 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3397947-7a26-4181-8f55-c158d9852582 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:27.192189 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3397947-7a26-4181-8f55-c158d9852582 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:27.192704 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3397947-7a26-4181-8f55-c158d9852582 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:27.194246 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 151/299] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:27.194351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e6ab5-2d76-407c-8d46-277173cde6ff None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:27.199961 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8b67b-7812-4ddc-9641-271fc5b877dc None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:27.200490 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8b67b-7812-4ddc-9641-271fc5b877dc None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:27.200997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8b67b-7812-4ddc-9641-271fc5b877dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:27.224877 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-00c8b67b-7812-4ddc-9641-271fc5b877dc None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:27.227087 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-00c8b67b-7812-4ddc-9641-271fc5b877dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:27.286062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:27.301124 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:27.308605 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 152/300] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:27.310474 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e6ab5-2d76-407c-8d46-277173cde6ff None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:27.346291 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b5447-2c6f-4aa0-aefe-364fbe859d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:27.347235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b5447-2c6f-4aa0-aefe-364fbe859d3f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:27.347710 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b5447-2c6f-4aa0-aefe-364fbe859d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:27.348174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b5447-2c6f-4aa0-aefe-364fbe859d3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:27.349526 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b5447-2c6f-4aa0-aefe-364fbe859d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:27.350959 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b5447-2c6f-4aa0-aefe-364fbe859d3f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:27.352514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 149/301] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:27.358053 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8b67b-7812-4ddc-9641-271fc5b877dc None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:27.402171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b5447-2c6f-4aa0-aefe-364fbe859d3f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:27.458916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8b67b-7812-4ddc-9641-271fc5b877dc None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:27.495190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45796a09-4cd5-4501-9b26-4c30b30119e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:27.496251 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45796a09-4cd5-4501-9b26-4c30b30119e8 None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:27.496704 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45796a09-4cd5-4501-9b26-4c30b30119e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:27.497153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45796a09-4cd5-4501-9b26-4c30b30119e8 None admin] PATH_INFO: `/v3/groups` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:27.498042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45796a09-4cd5-4501-9b26-4c30b30119e8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:27.500328 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45796a09-4cd5-4501-9b26-4c30b30119e8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:27.505030 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b5447-2c6f-4aa0-aefe-364fbe859d3f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:27.524627 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 153/302] 10.222.0.27 () {60 vars in 1134 bytes} [Sun Sep 25 00:41:27 2022] POST /identity/v3/groups => generated 229 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:41:27.551584 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1b36f-e65a-4131-851f-b19810168846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:27.552503 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1b36f-e65a-4131-851f-b19810168846 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:27.552988 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1b36f-e65a-4131-851f-b19810168846 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:27.553450 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1b36f-e65a-4131-851f-b19810168846 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:27.566708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1b36f-e65a-4131-851f-b19810168846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-dce1b36f-e65a-4131-851f-b19810168846 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:27.572181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:27.573583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:27.574514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:27.574514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:27.574514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:27.574514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:27.574514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:27.574514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:27.574514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:27.574514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:27.574514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:27.574514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:27.574514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:27.574514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:27.576795 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 150/303] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:41:27.583047 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45796a09-4cd5-4501-9b26-4c30b30119e8 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:27.600013 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1b36f-e65a-4131-851f-b19810168846 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:27.632383 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:27.641918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:27.721445 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45796a09-4cd5-4501-9b26-4c30b30119e8 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:27.725346 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1b36f-e65a-4131-851f-b19810168846 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:27.761463 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd06633-4312-4d8c-bc48-7de39426a97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:27.762172 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd06633-4312-4d8c-bc48-7de39426a97a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:27.762527 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd06633-4312-4d8c-bc48-7de39426a97a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:27.762874 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd06633-4312-4d8c-bc48-7de39426a97a None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:27.763621 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd06633-4312-4d8c-bc48-7de39426a97a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:27.763999 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd06633-4312-4d8c-bc48-7de39426a97a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:27.765699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd06633-4312-4d8c-bc48-7de39426a97a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:27.770005 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1909477-c15c-40de-bf79-fabdb796cfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:27.770932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1909477-c15c-40de-bf79-fabdb796cfd2 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:27.771441 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1909477-c15c-40de-bf79-fabdb796cfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:27.771888 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1909477-c15c-40de-bf79-fabdb796cfd2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:27.774439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 154/304] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:27.781963 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd06633-4312-4d8c-bc48-7de39426a97a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:27.783997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1909477-c15c-40de-bf79-fabdb796cfd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-e1909477-c15c-40de-bf79-fabdb796cfd2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:27.789585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:27.790704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:27.791669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:27.791669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:27.791669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:27.791669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:27.791669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:27.791669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:27.791669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:27.791669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:27.791669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:27.791669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:27.791669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:27.791669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:27.793693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 151/305] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:27.802515 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1909477-c15c-40de-bf79-fabdb796cfd2 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:27.907091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd06633-4312-4d8c-bc48-7de39426a97a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:27.913408 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:27.914398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:27.936638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1909477-c15c-40de-bf79-fabdb796cfd2 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:27.949626 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab75505-ea81-4c15-8ac9-039a395c8e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:27.950420 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab75505-ea81-4c15-8ac9-039a395c8e50 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:27.950706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab75505-ea81-4c15-8ac9-039a395c8e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:27.950986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab75505-ea81-4c15-8ac9-039a395c8e50 None admin] PATH_INFO: `/v3/users/b1a5af81aa2c42d7890bad274268a74e` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:27.972799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab75505-ea81-4c15-8ac9-039a395c8e50 None admin] RBAC: Authorizing `identity:get_user(user_id=b1a5af81aa2c42d7890bad274268a74e)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:27.974199 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab75505-ea81-4c15-8ac9-039a395c8e50 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:27.975911 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 155/306] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:27 2022] GET /identity/v3/users/b1a5af81aa2c42d7890bad274268a74e => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:27.983698 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab75505-ea81-4c15-8ac9-039a395c8e50 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:27.993965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c078e-1322-4940-bf0e-96719ae9896b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:27.994589 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c078e-1322-4940-bf0e-96719ae9896b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:27.995046 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c078e-1322-4940-bf0e-96719ae9896b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:27.995149 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c078e-1322-4940-bf0e-96719ae9896b None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:27.996036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c078e-1322-4940-bf0e-96719ae9896b None admin] RBAC: Adding query filter params (name=member) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:27.996347 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c078e-1322-4940-bf0e-96719ae9896b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:27.997881 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c078e-1322-4940-bf0e-96719ae9896b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:28.006658 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 152/307] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:28.012134 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c078e-1322-4940-bf0e-96719ae9896b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:28.090040 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab75505-ea81-4c15-8ac9-039a395c8e50 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:28.117665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c078e-1322-4940-bf0e-96719ae9896b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:28.127155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9576316-9537-4e8f-b9c7-0ba8ebd0d051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:28.127772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9576316-9537-4e8f-b9c7-0ba8ebd0d051 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:28.128112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9576316-9537-4e8f-b9c7-0ba8ebd0d051 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:28.128333 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9576316-9537-4e8f-b9c7-0ba8ebd0d051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:28.129104 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9576316-9537-4e8f-b9c7-0ba8ebd0d051 None admin] RBAC: Adding query filter params (role.id=8fcc3c7d309e469fad57a0bb086976fd, user.id=b1a5af81aa2c42d7890bad274268a74e, scope.system=all) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:28.129417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9576316-9537-4e8f-b9c7-0ba8ebd0d051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:28.130875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9576316-9537-4e8f-b9c7-0ba8ebd0d051 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:28.135893 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 156/308] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Sep 25 00:41:27 2022] GET /identity/v3/role_assignments?user.id=b1a5af81aa2c42d7890bad274268a74e&scope.system=all&role.id=8fcc3c7d309e469fad57a0bb086976fd => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:28.137076 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26d756-122f-4d06-b6a2-bda4768991ec None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:28.137360 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26d756-122f-4d06-b6a2-bda4768991ec None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:28.137636 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26d756-122f-4d06-b6a2-bda4768991ec None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:28.138871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 157/309] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:28.145273 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dde8f-59ac-4d79-b7f0-603735bd4c49 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:28.145563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dde8f-59ac-4d79-b7f0-603735bd4c49 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:28.145848 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dde8f-59ac-4d79-b7f0-603735bd4c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:28.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680c52c-8cbb-4e4a-9b01-9c03153e4d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:28.163940 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c52c-8cbb-4e4a-9b01-9c03153e4d8e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:28.164396 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c52c-8cbb-4e4a-9b01-9c03153e4d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:28.165013 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c52c-8cbb-4e4a-9b01-9c03153e4d8e None admin] PATH_INFO: `/v3/users/f8ec05240e8b4f82b193d9382e382240` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:28.165856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-fa5dde8f-59ac-4d79-b7f0-603735bd4c49 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:28.166646 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680c52c-8cbb-4e4a-9b01-9c03153e4d8e None admin] RBAC: Authorizing `identity:get_user(user_id=f8ec05240e8b4f82b193d9382e382240)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:28.167140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-fa5dde8f-59ac-4d79-b7f0-603735bd4c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:28.168593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680c52c-8cbb-4e4a-9b01-9c03153e4d8e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:28.170812 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 153/310] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:28 2022] GET /identity/v3/users/f8ec05240e8b4f82b193d9382e382240 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:28.177964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680c52c-8cbb-4e4a-9b01-9c03153e4d8e None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:28.195119 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:28.205167 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:28.262424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 158/311] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:28.313080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680c52c-8cbb-4e4a-9b01-9c03153e4d8e None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:28.348960 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e11a35-35f1-41c4-a260-c52c2a737b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:28.349909 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11a35-35f1-41c4-a260-c52c2a737b5e None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:28.350394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11a35-35f1-41c4-a260-c52c2a737b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:28.350847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11a35-35f1-41c4-a260-c52c2a737b5e None admin] PATH_INFO: `/v3/system/users/f8ec05240e8b4f82b193d9382e382240/roles/eab9c0818aa3414eb3a1a155830ad262` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:28.352421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e11a35-35f1-41c4-a260-c52c2a737b5e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f8ec05240e8b4f82b193d9382e382240, role_id=eab9c0818aa3414eb3a1a155830ad262)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:28.353987 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e11a35-35f1-41c4-a260-c52c2a737b5e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:28.366486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 154/312] 10.222.0.27 () {58 vars in 1334 bytes} [Sun Sep 25 00:41:28 2022] PUT /identity/v3/system/users/f8ec05240e8b4f82b193d9382e382240/roles/eab9c0818aa3414eb3a1a155830ad262 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:41:28.554632 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dde8f-59ac-4d79-b7f0-603735bd4c49 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:28.664763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dde8f-59ac-4d79-b7f0-603735bd4c49 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:28.700897 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee47c18-d898-4fc8-869b-fedbe050c4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:28.701819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47c18-d898-4fc8-869b-fedbe050c4ab None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:28.702295 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47c18-d898-4fc8-869b-fedbe050c4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:28.703291 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47c18-d898-4fc8-869b-fedbe050c4ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:28.714126 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee47c18-d898-4fc8-869b-fedbe050c4ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-0ee47c18-d898-4fc8-869b-fedbe050c4ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:28.719203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:28.720056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:28.720852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:28.720852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:28.720852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:28.720852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:28.720852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:28.720852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:28.720852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:28.720852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:28.720852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:28.720852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:28.720852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:28.720852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:28.723007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 159/313] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:28.728875 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e11a35-35f1-41c4-a260-c52c2a737b5e None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:28.825104 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:28.838191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e11a35-35f1-41c4-a260-c52c2a737b5e None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:28.872567 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9db56-038d-41b9-a1e2-2910d50ee314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:28.873188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9db56-038d-41b9-a1e2-2910d50ee314 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:28.873462 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9db56-038d-41b9-a1e2-2910d50ee314 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:28.873736 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9db56-038d-41b9-a1e2-2910d50ee314 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:28.874939 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9db56-038d-41b9-a1e2-2910d50ee314 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:28.875241 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9db56-038d-41b9-a1e2-2910d50ee314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:28.876649 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9db56-038d-41b9-a1e2-2910d50ee314 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:28.885588 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 155/314] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:28.891849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee47c18-d898-4fc8-869b-fedbe050c4ab None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:28.916741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:29.010867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee47c18-d898-4fc8-869b-fedbe050c4ab None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:29.045878 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615a6e9-3e2f-407d-b288-d706a7a066ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:29.047406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615a6e9-3e2f-407d-b288-d706a7a066ab None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:29.047882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615a6e9-3e2f-407d-b288-d706a7a066ab None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:29.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615a6e9-3e2f-407d-b288-d706a7a066ab None admin] PATH_INFO: `/v3/users/af460eab01864812b85fa0a896dd446d` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:29.049759 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615a6e9-3e2f-407d-b288-d706a7a066ab None admin] RBAC: Authorizing `identity:get_user(user_id=af460eab01864812b85fa0a896dd446d)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:29.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615a6e9-3e2f-407d-b288-d706a7a066ab None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:29.053693 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 160/315] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:28 2022] GET /identity/v3/users/af460eab01864812b85fa0a896dd446d => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:29.059333 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9db56-038d-41b9-a1e2-2910d50ee314 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:29.163966 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9db56-038d-41b9-a1e2-2910d50ee314 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:29.198871 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46940721-e376-4284-b26e-44fe3de721f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:29.199809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46940721-e376-4284-b26e-44fe3de721f1 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:29.200308 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46940721-e376-4284-b26e-44fe3de721f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:29.200810 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46940721-e376-4284-b26e-44fe3de721f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:29.216899 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:29.277536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46940721-e376-4284-b26e-44fe3de721f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:29.279027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46940721-e376-4284-b26e-44fe3de721f1 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:29.386360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 156/316] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:29.391953 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615a6e9-3e2f-407d-b288-d706a7a066ab None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:29.486176 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:29.503184 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615a6e9-3e2f-407d-b288-d706a7a066ab None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:29.538402 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05134c-646d-45ce-a392-4abd4405225d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:29.539096 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05134c-646d-45ce-a392-4abd4405225d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:29.539382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05134c-646d-45ce-a392-4abd4405225d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:29.539659 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05134c-646d-45ce-a392-4abd4405225d None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:29.540823 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05134c-646d-45ce-a392-4abd4405225d None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:29.542271 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05134c-646d-45ce-a392-4abd4405225d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:29.544078 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 161/317] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:29 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:29.550490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46940721-e376-4284-b26e-44fe3de721f1 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:29.607568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:29.670497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46940721-e376-4284-b26e-44fe3de721f1 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:29.707523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17750de-0feb-474c-a632-af46d4dfbe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:29.708160 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17750de-0feb-474c-a632-af46d4dfbe22 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:29.708442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17750de-0feb-474c-a632-af46d4dfbe22 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:29.708755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17750de-0feb-474c-a632-af46d4dfbe22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:29.709510 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17750de-0feb-474c-a632-af46d4dfbe22 None admin] RBAC: Adding query filter params (role.id=8fcc3c7d309e469fad57a0bb086976fd, scope.project.id=1c228a61fd2544379846b2c8a69fd2c3, user.id=af460eab01864812b85fa0a896dd446d) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:29.709829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17750de-0feb-474c-a632-af46d4dfbe22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:29.711420 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17750de-0feb-474c-a632-af46d4dfbe22 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:29.719089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 157/318] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:29 2022] GET /identity/v3/role_assignments?user.id=af460eab01864812b85fa0a896dd446d&scope.project.id=1c228a61fd2544379846b2c8a69fd2c3&role.id=8fcc3c7d309e469fad57a0bb086976fd => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:29.819838 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189bc5d-331f-47e8-8ec2-4949774da751 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:29.820034 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189bc5d-331f-47e8-8ec2-4949774da751 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:29.820314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189bc5d-331f-47e8-8ec2-4949774da751 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:29.821772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 162/319] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:29.831129 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe0844-8d19-45f4-ba88-a362a60d1361 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:29.831423 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe0844-8d19-45f4-ba88-a362a60d1361 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:29.831701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe0844-8d19-45f4-ba88-a362a60d1361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:29.852861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-defe0844-8d19-45f4-ba88-a362a60d1361 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:29.854154 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-defe0844-8d19-45f4-ba88-a362a60d1361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:29.926577 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 158/320] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:30.194763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189bc5d-331f-47e8-8ec2-4949774da751 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:30.307776 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189bc5d-331f-47e8-8ec2-4949774da751 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:30.345554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd090c7a-c9d8-42d6-8f3b-f558d18ceaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:30.346189 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090c7a-c9d8-42d6-8f3b-f558d18ceaeb None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:30.346466 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090c7a-c9d8-42d6-8f3b-f558d18ceaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:30.346739 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090c7a-c9d8-42d6-8f3b-f558d18ceaeb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:30.347825 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd090c7a-c9d8-42d6-8f3b-f558d18ceaeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:30.349369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd090c7a-c9d8-42d6-8f3b-f558d18ceaeb None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:30.351134 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 163/321] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:30.356436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe0844-8d19-45f4-ba88-a362a60d1361 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:30.391429 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:30.414192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78da7b5-35e0-437c-b418-5c1380caa03c None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:30.414696 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78da7b5-35e0-437c-b418-5c1380caa03c None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:30.414782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78da7b5-35e0-437c-b418-5c1380caa03c None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:30.416231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 164/322] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:41:30.420772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7a608-2dcc-43c6-8dba-f9b00e833199 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:30.421590 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7a608-2dcc-43c6-8dba-f9b00e833199 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:30.421866 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7a608-2dcc-43c6-8dba-f9b00e833199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:30.439951 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-5ea7a608-2dcc-43c6-8dba-f9b00e833199 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:30.441170 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-5ea7a608-2dcc-43c6-8dba-f9b00e833199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:30.457969 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:30.464668 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe0844-8d19-45f4-ba88-a362a60d1361 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:30.502439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b52eb-4380-4247-894e-669b3754f8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:30.503052 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b52eb-4380-4247-894e-669b3754f8c3 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:30.503330 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b52eb-4380-4247-894e-669b3754f8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:30.503601 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b52eb-4380-4247-894e-669b3754f8c3 None admin] PATH_INFO: `/v3/groups` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:30.504236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b52eb-4380-4247-894e-669b3754f8c3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:30.505708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b52eb-4380-4247-894e-669b3754f8c3 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:30.511188 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 165/323] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:30.523029 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 159/324] 10.222.0.27 () {60 vars in 1134 bytes} [Sun Sep 25 00:41:30 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:41:30.669225 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2013ef2-24d2-45f5-ad63-dee7899421c7 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:30.669557 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2013ef2-24d2-45f5-ad63-dee7899421c7 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:30.669782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2013ef2-24d2-45f5-ad63-dee7899421c7 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:30.671925 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 166/325] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:30.677348 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7ed7e-16dc-4d17-b6a1-84c3d30f660b None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:30.677639 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7ed7e-16dc-4d17-b6a1-84c3d30f660b None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:30.677895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7ed7e-16dc-4d17-b6a1-84c3d30f660b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:30.697687 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-cca7ed7e-16dc-4d17-b6a1-84c3d30f660b None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:30.699530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-cca7ed7e-16dc-4d17-b6a1-84c3d30f660b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:30.772057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 160/326] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:30.779482 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2013ef2-24d2-45f5-ad63-dee7899421c7 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:30.901583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2013ef2-24d2-45f5-ad63-dee7899421c7 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:30.941448 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33ebfb-b3c8-4b45-8d38-b9e6d95214de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:30.942770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33ebfb-b3c8-4b45-8d38-b9e6d95214de None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:30.943212 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33ebfb-b3c8-4b45-8d38-b9e6d95214de None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:30.943634 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33ebfb-b3c8-4b45-8d38-b9e6d95214de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:30.956581 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33ebfb-b3c8-4b45-8d38-b9e6d95214de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-2d33ebfb-b3c8-4b45-8d38-b9e6d95214de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:30.961405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:30.962265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:30.963062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:30.963062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:30.963062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:30.963062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:30.963062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:30.963062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:30.963062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:30.963062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:30.963062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:30.963062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:30.963062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:30.963062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:30.963062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 167/327] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:30.971481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7ed7e-16dc-4d17-b6a1-84c3d30f660b None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:31.003055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:31.056872 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33ebfb-b3c8-4b45-8d38-b9e6d95214de None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:31.074347 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:31.090458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7ed7e-16dc-4d17-b6a1-84c3d30f660b None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:31.136797 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56247c84-ce04-407f-82bc-c7a2d90584bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:31.137903 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56247c84-ce04-407f-82bc-c7a2d90584bf None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:31.138182 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56247c84-ce04-407f-82bc-c7a2d90584bf None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:31.138719 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56247c84-ce04-407f-82bc-c7a2d90584bf None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:31.139401 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56247c84-ce04-407f-82bc-c7a2d90584bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:31.140245 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56247c84-ce04-407f-82bc-c7a2d90584bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:31.142661 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56247c84-ce04-407f-82bc-c7a2d90584bf None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:31.154304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 161/328] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:31.160591 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56247c84-ce04-407f-82bc-c7a2d90584bf None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:31.181711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33ebfb-b3c8-4b45-8d38-b9e6d95214de None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:31.238974 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4ddad-2417-4aa2-9ad1-af3c38ba07a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:31.239655 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4ddad-2417-4aa2-9ad1-af3c38ba07a9 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:31.239937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4ddad-2417-4aa2-9ad1-af3c38ba07a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:31.240210 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4ddad-2417-4aa2-9ad1-af3c38ba07a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:31.257782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4ddad-2417-4aa2-9ad1-af3c38ba07a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-7fa4ddad-2417-4aa2-9ad1-af3c38ba07a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:31.264058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:31.265479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:31.266248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:31.266248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:31.266248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:31.266248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:31.266248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:31.266248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:31.266248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:31.266248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:31.266248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:31.266248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:31.266248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:31.266248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:31.271511 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 168/329] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:31.271921 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4ddad-2417-4aa2-9ad1-af3c38ba07a9 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:31.290351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:31.306682 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56247c84-ce04-407f-82bc-c7a2d90584bf None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:31.352735 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e536d8-cfe0-423d-b227-586dd03c70eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:31.353836 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e536d8-cfe0-423d-b227-586dd03c70eb None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:31.354287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e536d8-cfe0-423d-b227-586dd03c70eb None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:31.355006 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e536d8-cfe0-423d-b227-586dd03c70eb None admin] PATH_INFO: `/v3/users/b1a5af81aa2c42d7890bad274268a74e` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:31.356641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e536d8-cfe0-423d-b227-586dd03c70eb None admin] RBAC: Authorizing `identity:get_user(user_id=b1a5af81aa2c42d7890bad274268a74e)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:31.358900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e536d8-cfe0-423d-b227-586dd03c70eb None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:31.361715 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 162/330] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:31 2022] GET /identity/v3/users/b1a5af81aa2c42d7890bad274268a74e => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:31.368791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e536d8-cfe0-423d-b227-586dd03c70eb None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:31.375686 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:31.410618 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4ddad-2417-4aa2-9ad1-af3c38ba07a9 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:31.469293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eac28e-8fe2-49a8-af7e-4c660af1311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:31.469900 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eac28e-8fe2-49a8-af7e-4c660af1311e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:31.472588 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eac28e-8fe2-49a8-af7e-4c660af1311e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:31.472588 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eac28e-8fe2-49a8-af7e-4c660af1311e None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:31.472588 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eac28e-8fe2-49a8-af7e-4c660af1311e None admin] RBAC: Adding query filter params (name=member) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:31.472588 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eac28e-8fe2-49a8-af7e-4c660af1311e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:31.472921 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eac28e-8fe2-49a8-af7e-4c660af1311e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:31.488044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 169/331] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:31.497497 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eac28e-8fe2-49a8-af7e-4c660af1311e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:31.513840 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e536d8-cfe0-423d-b227-586dd03c70eb None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:31.578005 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58712f44-52a4-426d-ba99-6263e69f039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:31.578784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58712f44-52a4-426d-ba99-6263e69f039e None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:31.579070 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58712f44-52a4-426d-ba99-6263e69f039e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:31.579349 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58712f44-52a4-426d-ba99-6263e69f039e None admin] PATH_INFO: `/v3/system/users/b1a5af81aa2c42d7890bad274268a74e/roles/8fcc3c7d309e469fad57a0bb086976fd` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:31.580850 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58712f44-52a4-426d-ba99-6263e69f039e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b1a5af81aa2c42d7890bad274268a74e, role_id=8fcc3c7d309e469fad57a0bb086976fd)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:31.582295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58712f44-52a4-426d-ba99-6263e69f039e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:31.591326 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 163/332] 10.222.0.27 () {58 vars in 1334 bytes} [Sun Sep 25 00:41:31 2022] PUT /identity/v3/system/users/b1a5af81aa2c42d7890bad274268a74e/roles/8fcc3c7d309e469fad57a0bb086976fd => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:41:31.677319 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eac28e-8fe2-49a8-af7e-4c660af1311e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:31.728132 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21dc16-19fc-414f-8c0d-e729432fb80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:31.728817 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21dc16-19fc-414f-8c0d-e729432fb80d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:31.729097 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21dc16-19fc-414f-8c0d-e729432fb80d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:31.729378 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21dc16-19fc-414f-8c0d-e729432fb80d None admin] PATH_INFO: `/v3/users/f8ec05240e8b4f82b193d9382e382240` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:31.730541 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21dc16-19fc-414f-8c0d-e729432fb80d None admin] RBAC: Authorizing `identity:get_user(user_id=f8ec05240e8b4f82b193d9382e382240)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:31.731991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21dc16-19fc-414f-8c0d-e729432fb80d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:31.733977 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 170/333] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:31 2022] GET /identity/v3/users/f8ec05240e8b4f82b193d9382e382240 => generated 293 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:31.739738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58712f44-52a4-426d-ba99-6263e69f039e None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:31.779555 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:31.902588 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58712f44-52a4-426d-ba99-6263e69f039e None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:31.939493 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa18f5-f4bf-47d4-a1a9-62c6e1dfbb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:31.940035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa18f5-f4bf-47d4-a1a9-62c6e1dfbb32 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:31.940316 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa18f5-f4bf-47d4-a1a9-62c6e1dfbb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:31.940615 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa18f5-f4bf-47d4-a1a9-62c6e1dfbb32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:31.941395 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa18f5-f4bf-47d4-a1a9-62c6e1dfbb32 None admin] RBAC: Adding query filter params (role.id=eab9c0818aa3414eb3a1a155830ad262, user.id=f8ec05240e8b4f82b193d9382e382240, scope.system=all) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:31.941712 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa18f5-f4bf-47d4-a1a9-62c6e1dfbb32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:31.943150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa18f5-f4bf-47d4-a1a9-62c6e1dfbb32 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:31.956404 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 164/334] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Sep 25 00:41:31 2022] GET /identity/v3/role_assignments?user.id=f8ec05240e8b4f82b193d9382e382240&scope.system=all&role.id=eab9c0818aa3414eb3a1a155830ad262 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:33.327850 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da2acb-e42e-44cb-a225-a642adfa1efb None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:33.328878 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da2acb-e42e-44cb-a225-a642adfa1efb None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:33.329392 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da2acb-e42e-44cb-a225-a642adfa1efb None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:33.330971 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 171/335] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:33.347007 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e492f-185e-40df-bed1-3d6ee17059c2 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:33.347499 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e492f-185e-40df-bed1-3d6ee17059c2 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:33.347571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e492f-185e-40df-bed1-3d6ee17059c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:33.373692 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-629e492f-185e-40df-bed1-3d6ee17059c2 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:33.375005 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-629e492f-185e-40df-bed1-3d6ee17059c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:33.454526 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 165/336] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:33.878557 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5de32-e889-4f45-8977-cd3a9f1aad02 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:33.879220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5de32-e889-4f45-8977-cd3a9f1aad02 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:33.879697 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5de32-e889-4f45-8977-cd3a9f1aad02 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:33.881514 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 172/337] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:33.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b0981-3c10-457f-b40e-b0b03ec94f44 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:33.887544 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b0981-3c10-457f-b40e-b0b03ec94f44 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:33.888006 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b0981-3c10-457f-b40e-b0b03ec94f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:33.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-ba6b0981-3c10-457f-b40e-b0b03ec94f44 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:33.913485 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-ba6b0981-3c10-457f-b40e-b0b03ec94f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:33.915453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:33.995009 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 166/338] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:34.013412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5de32-e889-4f45-8977-cd3a9f1aad02 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:34.019324 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:34.140596 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5de32-e889-4f45-8977-cd3a9f1aad02 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:34.181867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6c9a6-1ff4-4fc0-93e5-e6329ad0ff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:34.182512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6c9a6-1ff4-4fc0-93e5-e6329ad0ff42 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:34.182788 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6c9a6-1ff4-4fc0-93e5-e6329ad0ff42 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:34.183061 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6c9a6-1ff4-4fc0-93e5-e6329ad0ff42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:34.200173 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6c9a6-1ff4-4fc0-93e5-e6329ad0ff42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-44e6c9a6-1ff4-4fc0-93e5-e6329ad0ff42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:34.206140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:34.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:34.207762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:34.207762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:34.207762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:34.207762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:34.207762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:34.207762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:34.207762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:34.207762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:34.207762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:34.207762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:34.207762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:34.207762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:34.207762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 173/339] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:34.214924 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b0981-3c10-457f-b40e-b0b03ec94f44 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:34.323572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb17848-84e6-43c5-9399-cb4604f8e1a3 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:34.324209 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb17848-84e6-43c5-9399-cb4604f8e1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:34.324732 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb17848-84e6-43c5-9399-cb4604f8e1a3 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:34.326271 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 174/340] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:41:34.331476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fba29-de41-4676-af4e-028876acc5d9 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:34.332420 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fba29-de41-4676-af4e-028876acc5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:34.332914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fba29-de41-4676-af4e-028876acc5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:34.351927 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-1f7fba29-de41-4676-af4e-028876acc5d9 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:34.353508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-1f7fba29-de41-4676-af4e-028876acc5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:34.410917 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b0981-3c10-457f-b40e-b0b03ec94f44 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:34.458202 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:34.475633 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 175/341] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:34.481881 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d423dd-c9da-442f-b594-9869ea208a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:34.482741 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d423dd-c9da-442f-b594-9869ea208a9b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:34.483214 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d423dd-c9da-442f-b594-9869ea208a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:34.484233 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d423dd-c9da-442f-b594-9869ea208a9b None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:34.485119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d423dd-c9da-442f-b594-9869ea208a9b None admin] RBAC: Adding query filter params (name=member) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:34.485617 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d423dd-c9da-442f-b594-9869ea208a9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:34.487365 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d423dd-c9da-442f-b594-9869ea208a9b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:34.498067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:34.501812 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 167/342] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:34.507585 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fba29-de41-4676-af4e-028876acc5d9 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:34.594796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d423dd-c9da-442f-b594-9869ea208a9b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:34.644625 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fba29-de41-4676-af4e-028876acc5d9 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:34.716006 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dac401-a899-4375-b8e4-80c6db89be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:34.716970 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dac401-a899-4375-b8e4-80c6db89be3b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:34.717468 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dac401-a899-4375-b8e4-80c6db89be3b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:34.718474 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dac401-a899-4375-b8e4-80c6db89be3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:34.799250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d423dd-c9da-442f-b594-9869ea208a9b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:34.824460 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:34.836269 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dac401-a899-4375-b8e4-80c6db89be3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:34.838415 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dac401-a899-4375-b8e4-80c6db89be3b None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:34.893276 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1bb59-8c63-4fdb-9930-4642046be8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:34.893914 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1bb59-8c63-4fdb-9930-4642046be8ba None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:34.894418 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1bb59-8c63-4fdb-9930-4642046be8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:34.894907 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1bb59-8c63-4fdb-9930-4642046be8ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:34.915305 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1bb59-8c63-4fdb-9930-4642046be8ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-81d1bb59-8c63-4fdb-9930-4642046be8ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:34.925004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:34.925882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:34.926659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:34.926659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:34.926659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:34.926659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:34.926659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:34.926659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:34.926659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:34.926659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:34.926659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:34.926659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:34.926659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:34.926659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:34.929282 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 168/343] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:41:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:41:34.930782 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9282b7e-4c27-44b1-a8bb-af2aa9a6fd91 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:34.931285 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9282b7e-4c27-44b1-a8bb-af2aa9a6fd91 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:34.931759 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9282b7e-4c27-44b1-a8bb-af2aa9a6fd91 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:34.933493 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 169/344] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:34.935385 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9282b7e-4c27-44b1-a8bb-af2aa9a6fd91 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:34.964577 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 176/345] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:34.966567 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c0da-5307-4cd4-8b36-2a709fe85c49 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:34.967003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c0da-5307-4cd4-8b36-2a709fe85c49 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:34.967477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c0da-5307-4cd4-8b36-2a709fe85c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:34.989696 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-a728c0da-5307-4cd4-8b36-2a709fe85c49 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:34.991205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-a728c0da-5307-4cd4-8b36-2a709fe85c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:35.031585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:35.069997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 177/346] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:35.078104 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728c0da-5307-4cd4-8b36-2a709fe85c49 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:35.083379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9282b7e-4c27-44b1-a8bb-af2aa9a6fd91 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:35.122791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181948ce-aaca-4084-93b6-eba9625210a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:35.123673 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181948ce-aaca-4084-93b6-eba9625210a2 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:35.124132 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181948ce-aaca-4084-93b6-eba9625210a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:35.124571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181948ce-aaca-4084-93b6-eba9625210a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:35.125802 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181948ce-aaca-4084-93b6-eba9625210a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:35.126256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181948ce-aaca-4084-93b6-eba9625210a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:35.127791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181948ce-aaca-4084-93b6-eba9625210a2 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:35.135484 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:35.138355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 170/347] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:35.140365 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181948ce-aaca-4084-93b6-eba9625210a2 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:35.256876 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181948ce-aaca-4084-93b6-eba9625210a2 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:35.284204 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:35.300311 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f3b15-c986-465d-8d2f-e4ed05c53e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:35.301219 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f3b15-c986-465d-8d2f-e4ed05c53e66 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:35.301641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f3b15-c986-465d-8d2f-e4ed05c53e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:35.302054 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f3b15-c986-465d-8d2f-e4ed05c53e66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:35.315963 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f3b15-c986-465d-8d2f-e4ed05c53e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-849f3b15-c986-465d-8d2f-e4ed05c53e66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:35.323228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:35.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:35.325453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:35.325453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:35.325453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:35.325453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:35.325453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:35.325453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:35.325453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:35.325453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:35.325453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:35.325453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:35.325453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:35.325453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:35.328592 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 171/348] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:35.330052 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f3b15-c986-465d-8d2f-e4ed05c53e66 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:35.347702 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728c0da-5307-4cd4-8b36-2a709fe85c49 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:35.444674 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f3b15-c986-465d-8d2f-e4ed05c53e66 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:35.445296 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b498229-63a4-41e2-ac51-97f51165cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:35.445970 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b498229-63a4-41e2-ac51-97f51165cfcc None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:35.446252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b498229-63a4-41e2-ac51-97f51165cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:35.446531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b498229-63a4-41e2-ac51-97f51165cfcc None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:35.447764 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b498229-63a4-41e2-ac51-97f51165cfcc None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:35.449534 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b498229-63a4-41e2-ac51-97f51165cfcc None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:35.452672 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 178/349] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:35 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:35.453469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b498229-63a4-41e2-ac51-97f51165cfcc None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:35.487607 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898120a-486f-4cf2-818a-dd7e017d6e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:35.488229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898120a-486f-4cf2-818a-dd7e017d6e7f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:35.488507 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898120a-486f-4cf2-818a-dd7e017d6e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:35.488807 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898120a-486f-4cf2-818a-dd7e017d6e7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:35.548275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:35.579013 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898120a-486f-4cf2-818a-dd7e017d6e7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:35.579013 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898120a-486f-4cf2-818a-dd7e017d6e7f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:35.586754 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:35.605581 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b498229-63a4-41e2-ac51-97f51165cfcc None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:35.655684 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7573d1b-106b-4623-b0d0-991f0f6ca76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:35.656680 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7573d1b-106b-4623-b0d0-991f0f6ca76e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:35.656930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7573d1b-106b-4623-b0d0-991f0f6ca76e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:35.657201 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7573d1b-106b-4623-b0d0-991f0f6ca76e None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:35.657892 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7573d1b-106b-4623-b0d0-991f0f6ca76e None admin] RBAC: Adding query filter params (name=member) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:35.658198 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7573d1b-106b-4623-b0d0-991f0f6ca76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:35.659709 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7573d1b-106b-4623-b0d0-991f0f6ca76e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:35.669551 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 179/350] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:35.670413 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7573d1b-106b-4623-b0d0-991f0f6ca76e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:35.722920 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 172/351] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:35.724508 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245274-bfd0-4fe1-8c3c-6d2521b933a5 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:35.725027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245274-bfd0-4fe1-8c3c-6d2521b933a5 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:35.725486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245274-bfd0-4fe1-8c3c-6d2521b933a5 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:35.727715 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 173/352] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:35.728768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a245274-bfd0-4fe1-8c3c-6d2521b933a5 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:35.794673 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7573d1b-106b-4623-b0d0-991f0f6ca76e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:35.848536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:35.850877 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5c61b-4a86-41e5-b94f-a6ed88777103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:35.851861 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c61b-4a86-41e5-b94f-a6ed88777103 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:35.852605 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c61b-4a86-41e5-b94f-a6ed88777103 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:35.853047 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c61b-4a86-41e5-b94f-a6ed88777103 None admin] PATH_INFO: `/v3/groups/d314c559443e4814b243686bda3f6ff4` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:35.859887 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5c61b-4a86-41e5-b94f-a6ed88777103 None admin] RBAC: Authorizing `identity:get_group(group_id=d314c559443e4814b243686bda3f6ff4)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:35.861450 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5c61b-4a86-41e5-b94f-a6ed88777103 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:35.863386 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 180/353] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:35 2022] GET /identity/v3/groups/d314c559443e4814b243686bda3f6ff4 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:35.863834 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5c61b-4a86-41e5-b94f-a6ed88777103 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:35.870795 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a245274-bfd0-4fe1-8c3c-6d2521b933a5 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:35.886451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:35.909711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d79466-c756-4e11-8b99-0df14029e794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:35.910352 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d79466-c756-4e11-8b99-0df14029e794 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:35.910635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d79466-c756-4e11-8b99-0df14029e794 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:35.910906 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d79466-c756-4e11-8b99-0df14029e794 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:35.922749 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d79466-c756-4e11-8b99-0df14029e794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-b1d79466-c756-4e11-8b99-0df14029e794 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:35.927824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:35.928897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:35.930131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:35.930131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:35.930131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:35.930131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:35.930131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:35.930131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:35.930131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:35.930131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:35.930131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:35.930131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:35.930131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:41:35.930131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:35.930772 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 174/354] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:35.931266 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d79466-c756-4e11-8b99-0df14029e794 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:35.990241 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5c61b-4a86-41e5-b94f-a6ed88777103 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:36.028352 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d8cca-291c-4bf5-b73b-620c269391fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:36.029028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d8cca-291c-4bf5-b73b-620c269391fe None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:36.029314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d8cca-291c-4bf5-b73b-620c269391fe None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:36.029588 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d8cca-291c-4bf5-b73b-620c269391fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:36.054046 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d79466-c756-4e11-8b99-0df14029e794 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:36.100409 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fb758-06f9-4483-a14c-ce3fdab90bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:36.101062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb758-06f9-4483-a14c-ce3fdab90bcd None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:36.101344 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb758-06f9-4483-a14c-ce3fdab90bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:36.101621 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb758-06f9-4483-a14c-ce3fdab90bcd None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:36.102928 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fb758-06f9-4483-a14c-ce3fdab90bcd None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:36.104262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d8cca-291c-4bf5-b73b-620c269391fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:36.104380 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fb758-06f9-4483-a14c-ce3fdab90bcd None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:36.105744 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d8cca-291c-4bf5-b73b-620c269391fe None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:36.106234 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 175/355] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:35 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:36.108398 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfb060-d79f-48f1-9413-8394107f345b None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:36.108708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfb060-d79f-48f1-9413-8394107f345b None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:36.108987 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfb060-d79f-48f1-9413-8394107f345b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:36.127262 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-1ecfb060-d79f-48f1-9413-8394107f345b None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:36.128479 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-1ecfb060-d79f-48f1-9413-8394107f345b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:36.128936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:36.132633 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:36.212237 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 176/356] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:36.213626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f3701-c1b1-459a-ab70-8f2aaada3d73 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:36.213919 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f3701-c1b1-459a-ab70-8f2aaada3d73 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:36.214193 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f3701-c1b1-459a-ab70-8f2aaada3d73 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:36.215783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 177/357] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:36.216773 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f3701-c1b1-459a-ab70-8f2aaada3d73 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:36.224057 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 181/358] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:36.225190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d8cca-291c-4bf5-b73b-620c269391fe None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:36.341263 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f3701-c1b1-459a-ab70-8f2aaada3d73 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:36.345373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d8cca-291c-4bf5-b73b-620c269391fe None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:36.368473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:36.382885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931cac9-5852-47f6-8689-413de1b8d5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:36.383931 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931cac9-5852-47f6-8689-413de1b8d5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:36.384391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931cac9-5852-47f6-8689-413de1b8d5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:36.385035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931cac9-5852-47f6-8689-413de1b8d5d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:36.385594 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bfb32-8287-4751-8e4a-00b2a1630b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:36.386163 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931cac9-5852-47f6-8689-413de1b8d5d5 None admin] RBAC: Adding query filter params (group.id=d314c559443e4814b243686bda3f6ff4, role.id=eab9c0818aa3414eb3a1a155830ad262, scope.project.id=106df7e3199d4f9896aebc029a0becf3) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:36.386276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bfb32-8287-4751-8e4a-00b2a1630b20 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:36.386468 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bfb32-8287-4751-8e4a-00b2a1630b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:36.386745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bfb32-8287-4751-8e4a-00b2a1630b20 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:36.387120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931cac9-5852-47f6-8689-413de1b8d5d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:36.387417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bfb32-8287-4751-8e4a-00b2a1630b20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:36.387721 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bfb32-8287-4751-8e4a-00b2a1630b20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:36.389138 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bfb32-8287-4751-8e4a-00b2a1630b20 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:36.390019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931cac9-5852-47f6-8689-413de1b8d5d5 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:36.397882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 178/359] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Sep 25 00:41:36 2022] GET /identity/v3/role_assignments?group.id=d314c559443e4814b243686bda3f6ff4&scope.project.id=106df7e3199d4f9896aebc029a0becf3&role.id=eab9c0818aa3414eb3a1a155830ad262 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:36.399004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931cac9-5852-47f6-8689-413de1b8d5d5 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:36.399587 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 182/360] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:36.401131 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279a93e-0587-47bc-b1eb-135ba021e4af None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:36.401491 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279a93e-0587-47bc-b1eb-135ba021e4af None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:36.401845 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279a93e-0587-47bc-b1eb-135ba021e4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:36.404877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:36.423959 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-7279a93e-0587-47bc-b1eb-135ba021e4af None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:36.425445 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-7279a93e-0587-47bc-b1eb-135ba021e4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:36.512582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 183/361] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:36.514096 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279a93e-0587-47bc-b1eb-135ba021e4af None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:36.538599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931cac9-5852-47f6-8689-413de1b8d5d5 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:36.586384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171dc90-caa8-464f-84ee-8868fc54aa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:36.587409 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171dc90-caa8-464f-84ee-8868fc54aa1d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:36.588662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171dc90-caa8-464f-84ee-8868fc54aa1d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:36.589166 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171dc90-caa8-464f-84ee-8868fc54aa1d None admin] PATH_INFO: `/v3/groups/d314c559443e4814b243686bda3f6ff4` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:36.591115 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171dc90-caa8-464f-84ee-8868fc54aa1d None admin] RBAC: Authorizing `identity:get_group(group_id=d314c559443e4814b243686bda3f6ff4)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:36.593558 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171dc90-caa8-464f-84ee-8868fc54aa1d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:36.596337 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 179/362] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:36 2022] GET /identity/v3/groups/d314c559443e4814b243686bda3f6ff4 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:36.597653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171dc90-caa8-464f-84ee-8868fc54aa1d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:36.661649 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279a93e-0587-47bc-b1eb-135ba021e4af None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:36.674166 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:36.679082 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:36.702729 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f307f26-06e1-4629-95e2-6db02a12763a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:36.703371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f307f26-06e1-4629-95e2-6db02a12763a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:36.703652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f307f26-06e1-4629-95e2-6db02a12763a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:36.703930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f307f26-06e1-4629-95e2-6db02a12763a None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:36.705115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f307f26-06e1-4629-95e2-6db02a12763a None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:36.706575 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f307f26-06e1-4629-95e2-6db02a12763a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:36.708212 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 184/363] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:36 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:36.709003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f307f26-06e1-4629-95e2-6db02a12763a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:36.716155 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171dc90-caa8-464f-84ee-8868fc54aa1d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:36.754702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840ea38-7f87-4281-a0da-464e6e6b59ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:36.755692 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840ea38-7f87-4281-a0da-464e6e6b59ef None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:36.756183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840ea38-7f87-4281-a0da-464e6e6b59ef None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:36.756739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840ea38-7f87-4281-a0da-464e6e6b59ef None admin] PATH_INFO: `/v3/users/b1a5af81aa2c42d7890bad274268a74e` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:36.758121 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840ea38-7f87-4281-a0da-464e6e6b59ef None admin] RBAC: Authorizing `identity:get_user(user_id=b1a5af81aa2c42d7890bad274268a74e)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:36.759926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840ea38-7f87-4281-a0da-464e6e6b59ef None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:36.762302 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 180/364] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:41:36 2022] GET /identity/v3/users/b1a5af81aa2c42d7890bad274268a74e => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:36.763478 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840ea38-7f87-4281-a0da-464e6e6b59ef None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:36.826643 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f307f26-06e1-4629-95e2-6db02a12763a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:36.869653 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59c904-a0ef-4608-bbc4-c27d5437f643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:36.870351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59c904-a0ef-4608-bbc4-c27d5437f643 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:36.870572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59c904-a0ef-4608-bbc4-c27d5437f643 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:36.870844 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59c904-a0ef-4608-bbc4-c27d5437f643 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:36.884025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59c904-a0ef-4608-bbc4-c27d5437f643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:36.887141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840ea38-7f87-4281-a0da-464e6e6b59ef None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-5b59c904-a0ef-4608-bbc4-c27d5437f643 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:36.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:36.889828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:36.890641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:36.890641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:36.890641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:36.890641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:36.890641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:36.890641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:36.890641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:36.890641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:36.890641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:36.890641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:36.890641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:36.890641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:36.890641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 185/365] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:41:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:36.891296 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59c904-a0ef-4608-bbc4-c27d5437f643 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:36.934201 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:36.937204 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bd758-7990-4cc9-972d-71af78799beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:36.937832 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd758-7990-4cc9-972d-71af78799beb None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:36.938142 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd758-7990-4cc9-972d-71af78799beb None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:36.938424 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd758-7990-4cc9-972d-71af78799beb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:36.939342 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bd758-7990-4cc9-972d-71af78799beb None admin] RBAC: Adding query filter params (group.id=d314c559443e4814b243686bda3f6ff4, role.id=3ebdb28c195f447294810f1033bb8e62, scope.project.id=106df7e3199d4f9896aebc029a0becf3) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:36.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bd758-7990-4cc9-972d-71af78799beb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:36.941143 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bd758-7990-4cc9-972d-71af78799beb None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:36.947662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 181/366] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Sep 25 00:41:36 2022] GET /identity/v3/role_assignments?group.id=d314c559443e4814b243686bda3f6ff4&scope.project.id=106df7e3199d4f9896aebc029a0becf3&role.id=3ebdb28c195f447294810f1033bb8e62 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:36.950251 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bd758-7990-4cc9-972d-71af78799beb None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:36.954407 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:37.013080 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59c904-a0ef-4608-bbc4-c27d5437f643 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:37.060072 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d9b8d-5c6e-4f90-9748-740ce73aa72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:37.061166 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d9b8d-5c6e-4f90-9748-740ce73aa72f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:37.061623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d9b8d-5c6e-4f90-9748-740ce73aa72f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:37.061989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d9b8d-5c6e-4f90-9748-740ce73aa72f None admin] PATH_INFO: `/v3/groups/d314c559443e4814b243686bda3f6ff4` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:37.063255 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d9b8d-5c6e-4f90-9748-740ce73aa72f None admin] RBAC: Authorizing `identity:get_group(group_id=d314c559443e4814b243686bda3f6ff4)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:37.064817 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d9b8d-5c6e-4f90-9748-740ce73aa72f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:37.066713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 186/367] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:36 2022] GET /identity/v3/groups/d314c559443e4814b243686bda3f6ff4 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:37.068053 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d9b8d-5c6e-4f90-9748-740ce73aa72f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:37.085329 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bd758-7990-4cc9-972d-71af78799beb None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:37.132545 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8682-c3b2-47fa-ab61-1cf82b250aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:37.133778 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8682-c3b2-47fa-ab61-1cf82b250aad None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:37.134350 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8682-c3b2-47fa-ab61-1cf82b250aad None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:37.134804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8682-c3b2-47fa-ab61-1cf82b250aad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:37.135836 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f8682-c3b2-47fa-ab61-1cf82b250aad None admin] RBAC: Adding query filter params (role.id=8fcc3c7d309e469fad57a0bb086976fd, user.id=b1a5af81aa2c42d7890bad274268a74e, scope.system=all) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:37.136399 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f8682-c3b2-47fa-ab61-1cf82b250aad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:37.138962 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f8682-c3b2-47fa-ab61-1cf82b250aad None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:37.164580 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 182/368] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Sep 25 00:41:36 2022] GET /identity/v3/role_assignments?user.id=b1a5af81aa2c42d7890bad274268a74e&scope.system=all&role.id=8fcc3c7d309e469fad57a0bb086976fd => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:37.164580 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8682-c3b2-47fa-ab61-1cf82b250aad None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:37.207438 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d9b8d-5c6e-4f90-9748-740ce73aa72f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:37.210279 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:37.273900 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477addb9-5779-40c3-b43f-105e7a7a1454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:37.274848 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477addb9-5779-40c3-b43f-105e7a7a1454 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:37.275286 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477addb9-5779-40c3-b43f-105e7a7a1454 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:37.275720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477addb9-5779-40c3-b43f-105e7a7a1454 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:37.294446 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:37.299558 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477addb9-5779-40c3-b43f-105e7a7a1454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-477addb9-5779-40c3-b43f-105e7a7a1454 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:37.307122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:37.308036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:37.309261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:37.309261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:37.309261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:37.309261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:37.309261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:37.309261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:37.309261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:37.309261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:37.309261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:37.309261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:37.309261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:37.309261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:37.309261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 187/369] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:41:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:37.309261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477addb9-5779-40c3-b43f-105e7a7a1454 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:37.366060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8682-c3b2-47fa-ab61-1cf82b250aad None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:37.426521 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2817bc9-16fa-4e73-b87f-6f6c77da0849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:37.427732 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2817bc9-16fa-4e73-b87f-6f6c77da0849 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:37.428473 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2817bc9-16fa-4e73-b87f-6f6c77da0849 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:37.429428 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2817bc9-16fa-4e73-b87f-6f6c77da0849 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:37.430596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2817bc9-16fa-4e73-b87f-6f6c77da0849 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:37.431125 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2817bc9-16fa-4e73-b87f-6f6c77da0849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:37.433025 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2817bc9-16fa-4e73-b87f-6f6c77da0849 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:37.450917 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 183/370] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:37.452231 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2817bc9-16fa-4e73-b87f-6f6c77da0849 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:37.479051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477addb9-5779-40c3-b43f-105e7a7a1454 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:37.518037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256109e1-9581-4329-805e-83896a5a126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:37.519003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256109e1-9581-4329-805e-83896a5a126f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:37.519503 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256109e1-9581-4329-805e-83896a5a126f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:37.519980 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256109e1-9581-4329-805e-83896a5a126f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:37.521126 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256109e1-9581-4329-805e-83896a5a126f None admin] RBAC: Adding query filter params (group.id=d314c559443e4814b243686bda3f6ff4, role.id=eab9c0818aa3414eb3a1a155830ad262, scope.project.id=1c228a61fd2544379846b2c8a69fd2c3) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:37.521774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256109e1-9581-4329-805e-83896a5a126f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:37.523587 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256109e1-9581-4329-805e-83896a5a126f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:37.530987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 188/371] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Sep 25 00:41:37 2022] GET /identity/v3/role_assignments?group.id=d314c559443e4814b243686bda3f6ff4&scope.project.id=1c228a61fd2544379846b2c8a69fd2c3&role.id=eab9c0818aa3414eb3a1a155830ad262 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:37.532259 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256109e1-9581-4329-805e-83896a5a126f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:37.569348 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:37.590636 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2817bc9-16fa-4e73-b87f-6f6c77da0849 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:37.624131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:37.637568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de14a5-3fac-4cb9-988c-f997a47736fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:37.638196 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de14a5-3fac-4cb9-988c-f997a47736fd None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:37.638476 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de14a5-3fac-4cb9-988c-f997a47736fd None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:37.638751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de14a5-3fac-4cb9-988c-f997a47736fd None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:37.639713 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de14a5-3fac-4cb9-988c-f997a47736fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:37.640023 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de14a5-3fac-4cb9-988c-f997a47736fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:37.641988 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de14a5-3fac-4cb9-988c-f997a47736fd None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:37.652074 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 184/372] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:37.658889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de14a5-3fac-4cb9-988c-f997a47736fd None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:37.668136 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256109e1-9581-4329-805e-83896a5a126f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:37.708618 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6b4ac-2def-4bae-b5ea-c790e495058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:37.709713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6b4ac-2def-4bae-b5ea-c790e495058f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:37.710214 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6b4ac-2def-4bae-b5ea-c790e495058f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:37.710718 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6b4ac-2def-4bae-b5ea-c790e495058f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:37.774440 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de14a5-3fac-4cb9-988c-f997a47736fd None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:37.794976 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6b4ac-2def-4bae-b5ea-c790e495058f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:37.797646 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6b4ac-2def-4bae-b5ea-c790e495058f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:37.818228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc1064-d630-4ed4-a298-1521dcee99e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:37.819216 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc1064-d630-4ed4-a298-1521dcee99e2 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:37.825959 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc1064-d630-4ed4-a298-1521dcee99e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:37.826582 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc1064-d630-4ed4-a298-1521dcee99e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:37.845702 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:37.898578 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:37.926376 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc1064-d630-4ed4-a298-1521dcee99e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:37.928195 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc1064-d630-4ed4-a298-1521dcee99e2 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:37.936657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 189/373] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:37.940892 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6b4ac-2def-4bae-b5ea-c790e495058f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:38.066686 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6b4ac-2def-4bae-b5ea-c790e495058f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:38.068590 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 185/374] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:38.079529 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc1064-d630-4ed4-a298-1521dcee99e2 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:38.100003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:38.108432 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafa824-7061-404d-81cf-6dfa827eb7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:38.109941 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafa824-7061-404d-81cf-6dfa827eb7ba None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:38.110222 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafa824-7061-404d-81cf-6dfa827eb7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:38.110497 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafa824-7061-404d-81cf-6dfa827eb7ba None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:38.112984 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafa824-7061-404d-81cf-6dfa827eb7ba None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:38.114455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafa824-7061-404d-81cf-6dfa827eb7ba None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:38.116099 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 190/375] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:37 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:38.125590 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafa824-7061-404d-81cf-6dfa827eb7ba None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:38.196102 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:38.213951 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc1064-d630-4ed4-a298-1521dcee99e2 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:38.250557 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afba425-5160-4909-9881-3d9fada2bc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:38.251461 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afba425-5160-4909-9881-3d9fada2bc18 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:38.251819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afba425-5160-4909-9881-3d9fada2bc18 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:38.252169 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afba425-5160-4909-9881-3d9fada2bc18 None admin] PATH_INFO: `/v3/projects/d20cd80763f84ad5bcde9f24ede790c8` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:38.253612 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afba425-5160-4909-9881-3d9fada2bc18 None admin] RBAC: Authorizing `identity:get_project(project_id=d20cd80763f84ad5bcde9f24ede790c8)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:38.255305 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afba425-5160-4909-9881-3d9fada2bc18 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:38.257449 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 186/376] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:38 2022] GET /identity/v3/projects/d20cd80763f84ad5bcde9f24ede790c8 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:38.262749 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afba425-5160-4909-9881-3d9fada2bc18 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:38.340901 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafa824-7061-404d-81cf-6dfa827eb7ba None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:38.398280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5c067-8706-4d08-9a1e-0af516e78687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:38.398987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5c067-8706-4d08-9a1e-0af516e78687 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:38.399215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5c067-8706-4d08-9a1e-0af516e78687 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:38.399497 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5c067-8706-4d08-9a1e-0af516e78687 None admin] PATH_INFO: `/v3/groups/d314c559443e4814b243686bda3f6ff4` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:38.400870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5c067-8706-4d08-9a1e-0af516e78687 None admin] RBAC: Authorizing `identity:get_group(group_id=d314c559443e4814b243686bda3f6ff4)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:38.402332 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5c067-8706-4d08-9a1e-0af516e78687 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:38.408666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 191/377] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:38 2022] GET /identity/v3/groups/d314c559443e4814b243686bda3f6ff4 => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:38.409948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afba425-5160-4909-9881-3d9fada2bc18 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:38.410300 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5c067-8706-4d08-9a1e-0af516e78687 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:38.448987 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5a800-3dd5-444c-aabe-bcb765f57c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:38.449848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a800-3dd5-444c-aabe-bcb765f57c49 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:38.450149 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a800-3dd5-444c-aabe-bcb765f57c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:38.450406 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a800-3dd5-444c-aabe-bcb765f57c49 None admin] PATH_INFO: `/v3/groups/cf1a04465e1a4774b6e3e5fad1a23182` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:38.458203 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5a800-3dd5-444c-aabe-bcb765f57c49 None admin] RBAC: Authorizing `identity:get_group(group_id=cf1a04465e1a4774b6e3e5fad1a23182)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:38.459963 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5a800-3dd5-444c-aabe-bcb765f57c49 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:38.461940 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 187/378] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:38 2022] GET /identity/v3/groups/cf1a04465e1a4774b6e3e5fad1a23182 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:38.468053 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5a800-3dd5-444c-aabe-bcb765f57c49 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:38.512933 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:38.536789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:38.634060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5c067-8706-4d08-9a1e-0af516e78687 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:38.636152 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5a800-3dd5-444c-aabe-bcb765f57c49 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:38.697668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895fdd9-7cfd-4b08-a4c6-ffd8c526096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:38.698916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895fdd9-7cfd-4b08-a4c6-ffd8c526096d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:38.699814 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895fdd9-7cfd-4b08-a4c6-ffd8c526096d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:38.700640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895fdd9-7cfd-4b08-a4c6-ffd8c526096d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:38.702015 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece60803-0c8b-4022-b03f-6e33cf73119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:38.702990 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895fdd9-7cfd-4b08-a4c6-ffd8c526096d None admin] RBAC: Adding query filter params (group.id=d314c559443e4814b243686bda3f6ff4, role.id=3ebdb28c195f447294810f1033bb8e62, scope.project.id=1c228a61fd2544379846b2c8a69fd2c3) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:38.703789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60803-0c8b-4022-b03f-6e33cf73119f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:38.704299 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895fdd9-7cfd-4b08-a4c6-ffd8c526096d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:38.706026 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895fdd9-7cfd-4b08-a4c6-ffd8c526096d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:38.706517 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60803-0c8b-4022-b03f-6e33cf73119f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:38.706988 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60803-0c8b-4022-b03f-6e33cf73119f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:38.707927 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece60803-0c8b-4022-b03f-6e33cf73119f None admin] RBAC: Adding query filter params (group.id=cf1a04465e1a4774b6e3e5fad1a23182, role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=d20cd80763f84ad5bcde9f24ede790c8) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:38.708450 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece60803-0c8b-4022-b03f-6e33cf73119f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:38.711838 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece60803-0c8b-4022-b03f-6e33cf73119f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:38.719686 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 192/379] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Sep 25 00:41:38 2022] GET /identity/v3/role_assignments?group.id=d314c559443e4814b243686bda3f6ff4&scope.project.id=1c228a61fd2544379846b2c8a69fd2c3&role.id=3ebdb28c195f447294810f1033bb8e62 => generated 260 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:38.721837 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 188/380] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Sep 25 00:41:38 2022] GET /identity/v3/role_assignments?group.id=cf1a04465e1a4774b6e3e5fad1a23182&scope.project.id=d20cd80763f84ad5bcde9f24ede790c8&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:39.232169 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aea9c-237f-4f19-b312-69002b75b051 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:39.232595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aea9c-237f-4f19-b312-69002b75b051 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:39.232774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aea9c-237f-4f19-b312-69002b75b051 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:39.234936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 193/381] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:39.240170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b0c95-22d1-447e-bfe0-a804f79a1b0f None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:39.240456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b0c95-22d1-447e-bfe0-a804f79a1b0f None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:39.240765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b0c95-22d1-447e-bfe0-a804f79a1b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:39.260210 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-806b0c95-22d1-447e-bfe0-a804f79a1b0f None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:39.261623 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-806b0c95-22d1-447e-bfe0-a804f79a1b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:39.338356 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 189/382] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:39.665092 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63ddc3-f5d4-42c3-ab32-54b6e81a05a9 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:39.665589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63ddc3-f5d4-42c3-ab32-54b6e81a05a9 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:39.665693 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63ddc3-f5d4-42c3-ab32-54b6e81a05a9 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:39.667312 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 194/383] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:39.672316 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd146b-1a36-4324-8a8f-017aa2cd72b5 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:39.672780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd146b-1a36-4324-8a8f-017aa2cd72b5 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:39.672963 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd146b-1a36-4324-8a8f-017aa2cd72b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:39.695196 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-54cd146b-1a36-4324-8a8f-017aa2cd72b5 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:39.696788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-54cd146b-1a36-4324-8a8f-017aa2cd72b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:39.708529 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:39.779134 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 190/384] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:39.816716 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63ddc3-f5d4-42c3-ab32-54b6e81a05a9 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:39.977324 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63ddc3-f5d4-42c3-ab32-54b6e81a05a9 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:40.011226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:40.025506 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468f67e-c2f6-4f1c-aeb3-ae6ea090415b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:40.026457 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468f67e-c2f6-4f1c-aeb3-ae6ea090415b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:40.026936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468f67e-c2f6-4f1c-aeb3-ae6ea090415b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:40.027430 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468f67e-c2f6-4f1c-aeb3-ae6ea090415b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:40.041507 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468f67e-c2f6-4f1c-aeb3-ae6ea090415b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-f468f67e-c2f6-4f1c-aeb3-ae6ea090415b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:40.047130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:40.048000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:40.048793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:40.048793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:40.048793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:40.048793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:40.048793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:40.048793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:40.048793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:40.048793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:40.048793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:40.048793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:40.048793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:40.048793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:40.051566 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 195/385] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:40.056965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd146b-1a36-4324-8a8f-017aa2cd72b5 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:40.078951 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468f67e-c2f6-4f1c-aeb3-ae6ea090415b None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:40.173823 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd146b-1a36-4324-8a8f-017aa2cd72b5 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:40.210590 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf52b1c-8ee6-4af8-99b4-3a51442f1fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:40.211344 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf52b1c-8ee6-4af8-99b4-3a51442f1fdd None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:40.211631 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf52b1c-8ee6-4af8-99b4-3a51442f1fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:40.211909 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf52b1c-8ee6-4af8-99b4-3a51442f1fdd None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:40.212591 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf52b1c-8ee6-4af8-99b4-3a51442f1fdd None admin] RBAC: Adding query filter params (name=member) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:40.212899 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf52b1c-8ee6-4af8-99b4-3a51442f1fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:40.214267 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf52b1c-8ee6-4af8-99b4-3a51442f1fdd None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:40.223237 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 191/386] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:40.229128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf52b1c-8ee6-4af8-99b4-3a51442f1fdd None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:40.232879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:40.327316 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468f67e-c2f6-4f1c-aeb3-ae6ea090415b None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:40.337070 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf52b1c-8ee6-4af8-99b4-3a51442f1fdd None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:40.373019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8d51c-f8d8-43c9-90b3-b2748f3d2744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:40.374311 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8d51c-f8d8-43c9-90b3-b2748f3d2744 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:40.374586 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8d51c-f8d8-43c9-90b3-b2748f3d2744 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:40.374854 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8d51c-f8d8-43c9-90b3-b2748f3d2744 None admin] PATH_INFO: `/v3/groups/d314c559443e4814b243686bda3f6ff4` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:40.376159 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8d51c-f8d8-43c9-90b3-b2748f3d2744 None admin] RBAC: Authorizing `identity:get_group(group_id=d314c559443e4814b243686bda3f6ff4)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:40.377687 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8d51c-f8d8-43c9-90b3-b2748f3d2744 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:40.379678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 192/387] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:40 2022] GET /identity/v3/groups/d314c559443e4814b243686bda3f6ff4 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:40.385658 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8d51c-f8d8-43c9-90b3-b2748f3d2744 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:40.412772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc02ed-a291-4238-8e82-f5fdf540339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:40.413419 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc02ed-a291-4238-8e82-f5fdf540339a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:40.413694 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc02ed-a291-4238-8e82-f5fdf540339a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:40.413966 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc02ed-a291-4238-8e82-f5fdf540339a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:40.437466 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc02ed-a291-4238-8e82-f5fdf540339a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-4cbc02ed-a291-4238-8e82-f5fdf540339a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:40.449071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:40.449931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:40.450707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:40.450707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:40.450707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:40.450707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:40.450707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:40.450707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:40.450707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:40.450707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:40.450707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:40.450707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:40.450707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:40.450707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:40.450707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 196/388] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:41:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:41:40.457460 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc02ed-a291-4238-8e82-f5fdf540339a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:40.485089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:40.517030 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8d51c-f8d8-43c9-90b3-b2748f3d2744 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:40.531842 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:40.554474 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857fc46-8f54-4dc7-b61b-612f67168b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:40.555321 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857fc46-8f54-4dc7-b61b-612f67168b93 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:40.556373 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857fc46-8f54-4dc7-b61b-612f67168b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:40.556684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857fc46-8f54-4dc7-b61b-612f67168b93 None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:40.557830 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857fc46-8f54-4dc7-b61b-612f67168b93 None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:40.559282 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857fc46-8f54-4dc7-b61b-612f67168b93 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:40.561668 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 193/389] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:40 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:40.564717 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2563e-da24-4b2a-903e-9a0533fb9da1 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:40.565030 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2563e-da24-4b2a-903e-9a0533fb9da1 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:40.565309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2563e-da24-4b2a-903e-9a0533fb9da1 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:40.566821 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 194/390] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:40.569654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2563e-da24-4b2a-903e-9a0533fb9da1 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:40.592862 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc02ed-a291-4238-8e82-f5fdf540339a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:40.627967 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840057e-b0bf-48ad-ae5d-d1bbcd2a4021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:40.628957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840057e-b0bf-48ad-ae5d-d1bbcd2a4021 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:40.629375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840057e-b0bf-48ad-ae5d-d1bbcd2a4021 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:40.629744 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840057e-b0bf-48ad-ae5d-d1bbcd2a4021 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:40.630507 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840057e-b0bf-48ad-ae5d-d1bbcd2a4021 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:40.630936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840057e-b0bf-48ad-ae5d-d1bbcd2a4021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:40.632467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840057e-b0bf-48ad-ae5d-d1bbcd2a4021 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:40.641601 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 197/391] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:40.643165 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c14d45-7d0d-484a-b66a-427d31aac2d3 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:40.643548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c14d45-7d0d-484a-b66a-427d31aac2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:40.643935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c14d45-7d0d-484a-b66a-427d31aac2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:40.663938 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-57c14d45-7d0d-484a-b66a-427d31aac2d3 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:40.665338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-57c14d45-7d0d-484a-b66a-427d31aac2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:40.682807 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2563e-da24-4b2a-903e-9a0533fb9da1 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:40.724359 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a136e79-1c5d-4ffe-b75b-6ab613d782ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:40.725191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136e79-1c5d-4ffe-b75b-6ab613d782ca None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:40.725471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136e79-1c5d-4ffe-b75b-6ab613d782ca None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:40.725743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136e79-1c5d-4ffe-b75b-6ab613d782ca None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3/groups/d314c559443e4814b243686bda3f6ff4/roles/eab9c0818aa3414eb3a1a155830ad262` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:40.727798 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a136e79-1c5d-4ffe-b75b-6ab613d782ca None admin] RBAC: Authorizing `identity:create_grant(project_id=106df7e3199d4f9896aebc029a0becf3, group_id=d314c559443e4814b243686bda3f6ff4, role_id=eab9c0818aa3414eb3a1a155830ad262)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:40.730060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a136e79-1c5d-4ffe-b75b-6ab613d782ca None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:40.738045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 198/392] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:40.739079 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c14d45-7d0d-484a-b66a-427d31aac2d3 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:40.747455 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 195/393] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Sep 25 00:41:40 2022] PUT /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3/groups/d314c559443e4814b243686bda3f6ff4/roles/eab9c0818aa3414eb3a1a155830ad262 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:41:40.748905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:40.789316 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:40.869546 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c14d45-7d0d-484a-b66a-427d31aac2d3 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:40.923323 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4d79c-b77c-4497-af89-13f2c1e30603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:40.923986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4d79c-b77c-4497-af89-13f2c1e30603 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:40.924262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4d79c-b77c-4497-af89-13f2c1e30603 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:40.924540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4d79c-b77c-4497-af89-13f2c1e30603 None admin] PATH_INFO: `/v3/groups/d314c559443e4814b243686bda3f6ff4` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:40.925714 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4d79c-b77c-4497-af89-13f2c1e30603 None admin] RBAC: Authorizing `identity:get_group(group_id=d314c559443e4814b243686bda3f6ff4)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:40.927152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4d79c-b77c-4497-af89-13f2c1e30603 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:40.929271 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 199/394] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:40 2022] GET /identity/v3/groups/d314c559443e4814b243686bda3f6ff4 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:40.934244 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a136e79-1c5d-4ffe-b75b-6ab613d782ca None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:41.040801 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a136e79-1c5d-4ffe-b75b-6ab613d782ca None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:41.077351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757b4d8-850e-42bb-9a83-2d8d60aa5a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:41.078345 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757b4d8-850e-42bb-9a83-2d8d60aa5a83 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:41.078832 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757b4d8-850e-42bb-9a83-2d8d60aa5a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:41.079358 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757b4d8-850e-42bb-9a83-2d8d60aa5a83 None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:41.082140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757b4d8-850e-42bb-9a83-2d8d60aa5a83 None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:41.083791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757b4d8-850e-42bb-9a83-2d8d60aa5a83 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:41.085985 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 196/395] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:40 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:41.094641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4d79c-b77c-4497-af89-13f2c1e30603 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:41.107649 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757b4d8-850e-42bb-9a83-2d8d60aa5a83 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:41.220920 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:41.278373 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757b4d8-850e-42bb-9a83-2d8d60aa5a83 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:41.285921 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4d79c-b77c-4497-af89-13f2c1e30603 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:41.307354 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:41.337720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99e43c-8ab5-4a79-b3a7-1d625d738f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:41.338739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99e43c-8ab5-4a79-b3a7-1d625d738f5c None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:41.339243 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99e43c-8ab5-4a79-b3a7-1d625d738f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:41.339715 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99e43c-8ab5-4a79-b3a7-1d625d738f5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:41.353250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99e43c-8ab5-4a79-b3a7-1d625d738f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-ac99e43c-8ab5-4a79-b3a7-1d625d738f5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:41.362229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:41.363093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:41.363949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:41.363949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:41.363949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:41.363949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:41.363949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:41.363949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:41.363949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:41.363949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:41.363949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:41.363949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:41.363949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:41.363949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:41.365677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a5b7d-2f32-4bfe-8948-12eed46850d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:41.366593 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a5b7d-2f32-4bfe-8948-12eed46850d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:41.367072 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a5b7d-2f32-4bfe-8948-12eed46850d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:41.367575 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a5b7d-2f32-4bfe-8948-12eed46850d7 None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3/groups/d314c559443e4814b243686bda3f6ff4/roles/3ebdb28c195f447294810f1033bb8e62` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:41.370763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 197/396] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:41.371629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a5b7d-2f32-4bfe-8948-12eed46850d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=106df7e3199d4f9896aebc029a0becf3, group_id=d314c559443e4814b243686bda3f6ff4, role_id=3ebdb28c195f447294810f1033bb8e62)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:41.378231 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99e43c-8ab5-4a79-b3a7-1d625d738f5c None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:41.379235 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a5b7d-2f32-4bfe-8948-12eed46850d7 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:41.403764 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 200/397] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Sep 25 00:41:41 2022] PUT /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3/groups/d314c559443e4814b243686bda3f6ff4/roles/3ebdb28c195f447294810f1033bb8e62 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:41:41.541382 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99e43c-8ab5-4a79-b3a7-1d625d738f5c None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:41.578709 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:41.590343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584b434-0ba5-4756-9e69-62a823d67538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:41.593086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d9f50-507d-4c1d-8fac-dee1f14c3ebf None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:41.593648 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d9f50-507d-4c1d-8fac-dee1f14c3ebf None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:41.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d9f50-507d-4c1d-8fac-dee1f14c3ebf None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:41.595799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 201/398] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:41:41.596737 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b434-0ba5-4756-9e69-62a823d67538 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:41.597259 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b434-0ba5-4756-9e69-62a823d67538 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:41.597756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b434-0ba5-4756-9e69-62a823d67538 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:41.598667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584b434-0ba5-4756-9e69-62a823d67538 None admin] RBAC: Adding query filter params (name=member) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:41.599234 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584b434-0ba5-4756-9e69-62a823d67538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:41.601013 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584b434-0ba5-4756-9e69-62a823d67538 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:41.601841 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d78d3-9c06-4f59-a67a-892048cc046d None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:41.602128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d78d3-9c06-4f59-a67a-892048cc046d None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:41.602410 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d78d3-9c06-4f59-a67a-892048cc046d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:41.632022 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 198/399] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:41.639774 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584b434-0ba5-4756-9e69-62a823d67538 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:41.647450 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-443d78d3-9c06-4f59-a67a-892048cc046d None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:41.650327 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-443d78d3-9c06-4f59-a67a-892048cc046d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:41.752825 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 202/400] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:41.754117 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c5d38-3bf2-4cd5-a47a-464416159032 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:41.754564 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c5d38-3bf2-4cd5-a47a-464416159032 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:41.755037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c5d38-3bf2-4cd5-a47a-464416159032 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:41.756799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 203/401] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:41.762169 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4405b-f2b5-40c7-a3df-144e308671d3 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:41.762678 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4405b-f2b5-40c7-a3df-144e308671d3 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:41.763124 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4405b-f2b5-40c7-a3df-144e308671d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:41.777537 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584b434-0ba5-4756-9e69-62a823d67538 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:41.796530 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-21f4405b-f2b5-40c7-a3df-144e308671d3 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:41.797827 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-21f4405b-f2b5-40c7-a3df-144e308671d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:41.823792 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda6655-7731-4227-8fcd-da9fa2f375f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:41.825325 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda6655-7731-4227-8fcd-da9fa2f375f9 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:41.825325 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda6655-7731-4227-8fcd-da9fa2f375f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:41.825325 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda6655-7731-4227-8fcd-da9fa2f375f9 None admin] PATH_INFO: `/v3/groups/d314c559443e4814b243686bda3f6ff4` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:41.829705 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda6655-7731-4227-8fcd-da9fa2f375f9 None admin] RBAC: Authorizing `identity:get_group(group_id=d314c559443e4814b243686bda3f6ff4)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:41.832048 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda6655-7731-4227-8fcd-da9fa2f375f9 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:41.834740 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 199/402] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:41 2022] GET /identity/v3/groups/d314c559443e4814b243686bda3f6ff4 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:41.840999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda6655-7731-4227-8fcd-da9fa2f375f9 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:41.916974 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:41.957980 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda6655-7731-4227-8fcd-da9fa2f375f9 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:41.978221 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 204/403] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:41.996136 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d1f49-794c-45d5-80a0-85febfb55d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:41.997042 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d1f49-794c-45d5-80a0-85febfb55d71 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:41.997485 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d1f49-794c-45d5-80a0-85febfb55d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:41.997915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d1f49-794c-45d5-80a0-85febfb55d71 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:41.999227 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d1f49-794c-45d5-80a0-85febfb55d71 None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:42.000856 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d1f49-794c-45d5-80a0-85febfb55d71 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:42.002929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 200/404] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:41 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:42.008856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4405b-f2b5-40c7-a3df-144e308671d3 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:42.038646 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:42.044326 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d1f49-794c-45d5-80a0-85febfb55d71 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:42.119045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4405b-f2b5-40c7-a3df-144e308671d3 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:42.160697 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255b636-2bc9-4006-ba25-b8212759ce76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:42.161766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b636-2bc9-4006-ba25-b8212759ce76 None admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:42.162259 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b636-2bc9-4006-ba25-b8212759ce76 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:42.162734 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b636-2bc9-4006-ba25-b8212759ce76 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3/groups/d314c559443e4814b243686bda3f6ff4/roles/eab9c0818aa3414eb3a1a155830ad262` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:42.165103 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255b636-2bc9-4006-ba25-b8212759ce76 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c228a61fd2544379846b2c8a69fd2c3, group_id=d314c559443e4814b243686bda3f6ff4, role_id=eab9c0818aa3414eb3a1a155830ad262)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:42.166993 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255b636-2bc9-4006-ba25-b8212759ce76 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:42.193608 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 205/405] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Sep 25 00:41:42 2022] PUT /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3/groups/d314c559443e4814b243686bda3f6ff4/roles/eab9c0818aa3414eb3a1a155830ad262 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:41:42.257562 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d1f49-794c-45d5-80a0-85febfb55d71 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:42.282673 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255b636-2bc9-4006-ba25-b8212759ce76 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:42.302354 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:42.318988 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85daeb7-bd92-4f9c-b913-32856ebd4ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:42.321240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85daeb7-bd92-4f9c-b913-32856ebd4ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:42.322600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85daeb7-bd92-4f9c-b913-32856ebd4ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:42.323429 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85daeb7-bd92-4f9c-b913-32856ebd4ef1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:42.350078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85daeb7-bd92-4f9c-b913-32856ebd4ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-e85daeb7-bd92-4f9c-b913-32856ebd4ef1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:42.359654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:42.360630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:42.361421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:42.361421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:42.361421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:42.361421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:42.361421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:42.361421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:42.361421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:42.361421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:42.361421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:42.361421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:42.361421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:42.361421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:42.364761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 201/406] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:41:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:41:42.371716 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85daeb7-bd92-4f9c-b913-32856ebd4ef1 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:42.416349 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:42.432461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255b636-2bc9-4006-ba25-b8212759ce76 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:42.471038 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab40ab-24a1-4d03-ac72-cb7e73de5d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:42.471775 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab40ab-24a1-4d03-ac72-cb7e73de5d88 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:42.472127 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab40ab-24a1-4d03-ac72-cb7e73de5d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:42.473901 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab40ab-24a1-4d03-ac72-cb7e73de5d88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:42.486813 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab40ab-24a1-4d03-ac72-cb7e73de5d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-e6ab40ab-24a1-4d03-ac72-cb7e73de5d88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:42.493889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:42.494856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:42.495766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:42.495766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:42.495766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:42.495766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:42.495766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:42.495766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:42.495766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:42.495766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:42.495766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:42.495766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:42.495766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:42.495766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:42.495766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 206/407] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:41:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:41:42.502801 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85daeb7-bd92-4f9c-b913-32856ebd4ef1 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:42.507585 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab40ab-24a1-4d03-ac72-cb7e73de5d88 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:42.557040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14d5d0-24e7-4092-8ac8-8778be422fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:42.558022 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14d5d0-24e7-4092-8ac8-8778be422fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:42.558496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14d5d0-24e7-4092-8ac8-8778be422fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:42.558962 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14d5d0-24e7-4092-8ac8-8778be422fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:42.559923 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14d5d0-24e7-4092-8ac8-8778be422fa8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:42.560540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14d5d0-24e7-4092-8ac8-8778be422fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:42.562794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14d5d0-24e7-4092-8ac8-8778be422fa8 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:42.572342 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 202/408] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:42.581525 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14d5d0-24e7-4092-8ac8-8778be422fa8 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:42.615422 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab40ab-24a1-4d03-ac72-cb7e73de5d88 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:42.674582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca2d1c-77d0-4716-a1a5-f851747cc52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:42.675203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca2d1c-77d0-4716-a1a5-f851747cc52e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:42.675487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca2d1c-77d0-4716-a1a5-f851747cc52e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:42.675761 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca2d1c-77d0-4716-a1a5-f851747cc52e None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:42.676440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca2d1c-77d0-4716-a1a5-f851747cc52e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:42.676768 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca2d1c-77d0-4716-a1a5-f851747cc52e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:42.678162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca2d1c-77d0-4716-a1a5-f851747cc52e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:42.682276 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:42.692636 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 207/409] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:42.698973 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca2d1c-77d0-4716-a1a5-f851747cc52e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:42.720909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:42.757110 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14d5d0-24e7-4092-8ac8-8778be422fa8 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:42.794762 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33a72c-9a83-4d52-b081-d03daf9a188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:42.795946 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33a72c-9a83-4d52-b081-d03daf9a188b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:42.796301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33a72c-9a83-4d52-b081-d03daf9a188b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:42.796654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33a72c-9a83-4d52-b081-d03daf9a188b None admin] PATH_INFO: `/v3/groups/d314c559443e4814b243686bda3f6ff4` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:42.798114 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33a72c-9a83-4d52-b081-d03daf9a188b None admin] RBAC: Authorizing `identity:get_group(group_id=d314c559443e4814b243686bda3f6ff4)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:42.799745 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33a72c-9a83-4d52-b081-d03daf9a188b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:42.801815 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 203/410] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:42 2022] GET /identity/v3/groups/d314c559443e4814b243686bda3f6ff4 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:42.809847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33a72c-9a83-4d52-b081-d03daf9a188b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:42.938662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33a72c-9a83-4d52-b081-d03daf9a188b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:42.946388 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca2d1c-77d0-4716-a1a5-f851747cc52e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:42.969158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:43.002612 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1cab0-2e11-4d76-9443-aee923516a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:43.003248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1cab0-2e11-4d76-9443-aee923516a62 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:43.003522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1cab0-2e11-4d76-9443-aee923516a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:43.003793 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1cab0-2e11-4d76-9443-aee923516a62 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:43.007384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1cab0-2e11-4d76-9443-aee923516a62 None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:43.009255 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1cab0-2e11-4d76-9443-aee923516a62 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:43.010882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 204/411] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:42 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:43.017599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1cab0-2e11-4d76-9443-aee923516a62 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:43.020121 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355839e0-65ea-4983-8185-b67284f41444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:43.020785 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355839e0-65ea-4983-8185-b67284f41444 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:43.021063 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355839e0-65ea-4983-8185-b67284f41444 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:43.021334 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355839e0-65ea-4983-8185-b67284f41444 None admin] PATH_INFO: `/v3/groups/cf1a04465e1a4774b6e3e5fad1a23182` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:43.024193 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355839e0-65ea-4983-8185-b67284f41444 None admin] RBAC: Authorizing `identity:get_group(group_id=cf1a04465e1a4774b6e3e5fad1a23182)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:43.025669 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355839e0-65ea-4983-8185-b67284f41444 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:43.028585 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 208/412] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:42 2022] GET /identity/v3/groups/cf1a04465e1a4774b6e3e5fad1a23182 => generated 229 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:43.033379 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355839e0-65ea-4983-8185-b67284f41444 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:43.193480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:43.207681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1cab0-2e11-4d76-9443-aee923516a62 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:43.249277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355839e0-65ea-4983-8185-b67284f41444 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:43.256152 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c29d31-2bf2-458a-a3b4-cd8b5b180225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:43.258285 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c29d31-2bf2-458a-a3b4-cd8b5b180225 None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:43.263258 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c29d31-2bf2-458a-a3b4-cd8b5b180225 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:43.263929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c29d31-2bf2-458a-a3b4-cd8b5b180225 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3/groups/d314c559443e4814b243686bda3f6ff4/roles/3ebdb28c195f447294810f1033bb8e62` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:43.268929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c29d31-2bf2-458a-a3b4-cd8b5b180225 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c228a61fd2544379846b2c8a69fd2c3, group_id=d314c559443e4814b243686bda3f6ff4, role_id=3ebdb28c195f447294810f1033bb8e62)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:43.270708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c29d31-2bf2-458a-a3b4-cd8b5b180225 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:43.298287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 205/413] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Sep 25 00:41:43 2022] PUT /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3/groups/d314c559443e4814b243686bda3f6ff4/roles/3ebdb28c195f447294810f1033bb8e62 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:41:43.315139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ee7c8-75e7-46a5-8b7a-3b8e98a4c437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:43.316221 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ee7c8-75e7-46a5-8b7a-3b8e98a4c437 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:43.316771 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ee7c8-75e7-46a5-8b7a-3b8e98a4c437 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:43.317252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ee7c8-75e7-46a5-8b7a-3b8e98a4c437 None admin] PATH_INFO: `/v3/projects/d20cd80763f84ad5bcde9f24ede790c8` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:43.318697 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ee7c8-75e7-46a5-8b7a-3b8e98a4c437 None admin] RBAC: Authorizing `identity:get_project(project_id=d20cd80763f84ad5bcde9f24ede790c8)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:43.320468 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ee7c8-75e7-46a5-8b7a-3b8e98a4c437 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:43.323206 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 209/414] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:43 2022] GET /identity/v3/projects/d20cd80763f84ad5bcde9f24ede790c8 => generated 344 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:43.329179 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c29d31-2bf2-458a-a3b4-cd8b5b180225 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:43.394224 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:43.408090 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba515bae-bcec-4f7a-94b7-be85f5a27eea None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:43.408388 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba515bae-bcec-4f7a-94b7-be85f5a27eea None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:43.408668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba515bae-bcec-4f7a-94b7-be85f5a27eea None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:43.410148 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 210/415] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:43.416205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393e8b1-bf5d-4925-aa77-14d3510e0f8c None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:43.416490 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393e8b1-bf5d-4925-aa77-14d3510e0f8c None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:43.416802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393e8b1-bf5d-4925-aa77-14d3510e0f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:43.457695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-4393e8b1-bf5d-4925-aa77-14d3510e0f8c None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:43.458860 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-4393e8b1-bf5d-4925-aa77-14d3510e0f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:43.464089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c29d31-2bf2-458a-a3b4-cd8b5b180225 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:43.524373 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cccc4a-6366-4209-b6af-320233c45cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:43.526226 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cccc4a-6366-4209-b6af-320233c45cad None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:43.526512 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cccc4a-6366-4209-b6af-320233c45cad None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:43.526786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cccc4a-6366-4209-b6af-320233c45cad None admin] PATH_INFO: `/v3/projects/d20cd80763f84ad5bcde9f24ede790c8/groups/cf1a04465e1a4774b6e3e5fad1a23182/roles/a6d585feb70946b1b1ebcaece17d26b2` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:43.530335 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cccc4a-6366-4209-b6af-320233c45cad None admin] RBAC: Authorizing `identity:create_grant(project_id=d20cd80763f84ad5bcde9f24ede790c8, group_id=cf1a04465e1a4774b6e3e5fad1a23182, role_id=a6d585feb70946b1b1ebcaece17d26b2)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:43.531793 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cccc4a-6366-4209-b6af-320233c45cad None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:43.561990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 206/416] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Sep 25 00:41:43 2022] PUT /identity/v3/projects/d20cd80763f84ad5bcde9f24ede790c8/groups/cf1a04465e1a4774b6e3e5fad1a23182/roles/a6d585feb70946b1b1ebcaece17d26b2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:41:43.580167 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 211/417] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:43.884982 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cccc4a-6366-4209-b6af-320233c45cad None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:43.993489 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cccc4a-6366-4209-b6af-320233c45cad None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:43.997295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:44.037817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472153a-ad05-43a9-9b89-64ba53d45141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:44.038479 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472153a-ad05-43a9-9b89-64ba53d45141 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:44.038839 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472153a-ad05-43a9-9b89-64ba53d45141 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:44.039122 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472153a-ad05-43a9-9b89-64ba53d45141 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:44.051948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472153a-ad05-43a9-9b89-64ba53d45141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-7472153a-ad05-43a9-9b89-64ba53d45141 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:44.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:44.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:44.059757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:44.059757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:44.059757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:44.059757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:44.059757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:44.059757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:44.059757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:44.059757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:44.059757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:44.059757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:44.059757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:44.059757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:44.059757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 207/418] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:44.065140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393e8b1-bf5d-4925-aa77-14d3510e0f8c None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:44.150619 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:44.187284 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3ff00-81ae-47e6-9e5a-203e2b8f4538 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:44.187624 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3ff00-81ae-47e6-9e5a-203e2b8f4538 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:44.187918 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3ff00-81ae-47e6-9e5a-203e2b8f4538 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:44.189644 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 208/419] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:44.191247 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393e8b1-bf5d-4925-aa77-14d3510e0f8c None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:44.197401 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dece8-8591-450a-b63f-9732a0d68b4b None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:44.197948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dece8-8591-450a-b63f-9732a0d68b4b None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:44.198227 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dece8-8591-450a-b63f-9732a0d68b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:44.235521 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-0b2dece8-8591-450a-b63f-9732a0d68b4b None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:44.236767 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-0b2dece8-8591-450a-b63f-9732a0d68b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:44.265662 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ea2d3-a725-4f71-973d-95c373353efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:44.266646 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea2d3-a725-4f71-973d-95c373353efa None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:44.267116 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea2d3-a725-4f71-973d-95c373353efa None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:44.267586 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea2d3-a725-4f71-973d-95c373353efa None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:44.268445 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ea2d3-a725-4f71-973d-95c373353efa None admin] RBAC: Adding query filter params (name=member) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:44.269020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ea2d3-a725-4f71-973d-95c373353efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:44.270595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ea2d3-a725-4f71-973d-95c373353efa None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:44.292019 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 212/420] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:44.300481 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ea2d3-a725-4f71-973d-95c373353efa None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:44.324453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 209/421] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:44.458954 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ea2d3-a725-4f71-973d-95c373353efa None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:44.499230 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6370065-b6e6-4150-8498-7aa308da4ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:44.499857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6370065-b6e6-4150-8498-7aa308da4ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:44.500139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6370065-b6e6-4150-8498-7aa308da4ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:44.500532 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6370065-b6e6-4150-8498-7aa308da4ec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:44.513047 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:44.600332 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6370065-b6e6-4150-8498-7aa308da4ec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:44.605943 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6370065-b6e6-4150-8498-7aa308da4ec6 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:44.688145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a501700-0a7a-47b6-9438-9763af300ac3 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:44.688468 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a501700-0a7a-47b6-9438-9763af300ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:44.688738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a501700-0a7a-47b6-9438-9763af300ac3 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:44.690228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 210/422] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:41:44.690789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a501700-0a7a-47b6-9438-9763af300ac3 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:44.737453 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 213/423] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:44.738985 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ade8e7-8f99-47a5-945f-7edf1dba1003 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:44.739463 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ade8e7-8f99-47a5-945f-7edf1dba1003 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:44.739966 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ade8e7-8f99-47a5-945f-7edf1dba1003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:44.767934 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-d8ade8e7-8f99-47a5-945f-7edf1dba1003 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:44.769729 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-d8ade8e7-8f99-47a5-945f-7edf1dba1003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:44.807143 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:44.815761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:44.825471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a501700-0a7a-47b6-9438-9763af300ac3 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:44.861842 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de29d8-31b8-4a3b-91fe-8a906d345ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:44.868580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 214/424] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:44.868580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ade8e7-8f99-47a5-945f-7edf1dba1003 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:44.869526 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de29d8-31b8-4a3b-91fe-8a906d345ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:44.870078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de29d8-31b8-4a3b-91fe-8a906d345ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:44.870563 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de29d8-31b8-4a3b-91fe-8a906d345ff5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:44.895823 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de29d8-31b8-4a3b-91fe-8a906d345ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-f5de29d8-31b8-4a3b-91fe-8a906d345ff5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:44.901518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:44.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:44.903176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:44.903176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:44.903176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:44.903176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:44.903176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:44.903176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:44.903176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:44.903176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:44.903176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:44.903176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:44.903176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:44.903176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:44.913597 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 211/425] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:41:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:44.919211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de29d8-31b8-4a3b-91fe-8a906d345ff5 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:44.981904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ade8e7-8f99-47a5-945f-7edf1dba1003 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:45.024183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce276f8-d2e9-42aa-9269-103674238f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:45.025159 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce276f8-d2e9-42aa-9269-103674238f61 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:45.025459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce276f8-d2e9-42aa-9269-103674238f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:45.025737 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce276f8-d2e9-42aa-9269-103674238f61 None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:45.027141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce276f8-d2e9-42aa-9269-103674238f61 None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:45.029267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce276f8-d2e9-42aa-9269-103674238f61 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:45.032125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 215/426] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:44 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:45.037549 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce276f8-d2e9-42aa-9269-103674238f61 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:45.078556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:45.138454 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de29d8-31b8-4a3b-91fe-8a906d345ff5 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:45.154344 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce276f8-d2e9-42aa-9269-103674238f61 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:45.192426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff043b-39f8-4be3-b04e-808178b26639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:45.193736 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff043b-39f8-4be3-b04e-808178b26639 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:45.194226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff043b-39f8-4be3-b04e-808178b26639 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:45.194679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff043b-39f8-4be3-b04e-808178b26639 None admin] PATH_INFO: `/v3/groups/d314c559443e4814b243686bda3f6ff4` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:45.196275 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff043b-39f8-4be3-b04e-808178b26639 None admin] RBAC: Authorizing `identity:get_group(group_id=d314c559443e4814b243686bda3f6ff4)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:45.198205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff043b-39f8-4be3-b04e-808178b26639 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:45.200801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 216/427] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:45 2022] GET /identity/v3/groups/d314c559443e4814b243686bda3f6ff4 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:45.207413 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff043b-39f8-4be3-b04e-808178b26639 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:45.250983 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d785e7a-8610-4cd4-a41e-d19f0893c068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:45.251608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785e7a-8610-4cd4-a41e-d19f0893c068 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:45.251887 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785e7a-8610-4cd4-a41e-d19f0893c068 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:45.252160 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785e7a-8610-4cd4-a41e-d19f0893c068 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:45.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d785e7a-8610-4cd4-a41e-d19f0893c068 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:45.253167 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d785e7a-8610-4cd4-a41e-d19f0893c068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:45.254558 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d785e7a-8610-4cd4-a41e-d19f0893c068 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:45.263263 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 212/428] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:45.264570 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d785e7a-8610-4cd4-a41e-d19f0893c068 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:45.289898 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:45.338589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff043b-39f8-4be3-b04e-808178b26639 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:45.356887 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:45.377814 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d785e7a-8610-4cd4-a41e-d19f0893c068 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:45.390994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b27de-9bca-43a3-a4ac-2d07fa658151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:45.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b27de-9bca-43a3-a4ac-2d07fa658151 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:45.393012 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b27de-9bca-43a3-a4ac-2d07fa658151 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:45.393440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b27de-9bca-43a3-a4ac-2d07fa658151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:45.394582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b27de-9bca-43a3-a4ac-2d07fa658151 None admin] RBAC: Adding query filter params (group.id=d314c559443e4814b243686bda3f6ff4, role.id=eab9c0818aa3414eb3a1a155830ad262, scope.project.id=106df7e3199d4f9896aebc029a0becf3) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:45.395037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b27de-9bca-43a3-a4ac-2d07fa658151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:45.397520 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b27de-9bca-43a3-a4ac-2d07fa658151 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:45.410725 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 217/429] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Sep 25 00:41:45 2022] GET /identity/v3/role_assignments?group.id=d314c559443e4814b243686bda3f6ff4&scope.project.id=106df7e3199d4f9896aebc029a0becf3&role.id=eab9c0818aa3414eb3a1a155830ad262 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:45.410725 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b27de-9bca-43a3-a4ac-2d07fa658151 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:45.430274 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb713c-6e0f-4a25-915f-ab114932109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:45.430993 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb713c-6e0f-4a25-915f-ab114932109f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:45.431273 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb713c-6e0f-4a25-915f-ab114932109f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:45.431598 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb713c-6e0f-4a25-915f-ab114932109f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:45.454823 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb713c-6e0f-4a25-915f-ab114932109f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-f2fb713c-6e0f-4a25-915f-ab114932109f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:45.461851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:45.462780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:45.463587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:45.463587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:45.463587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:45.463587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:45.463587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:45.463587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:45.463587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:45.463587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:45.463587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:45.463587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:45.463587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:41:45.463587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:45.463587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 213/430] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:45.468670 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb713c-6e0f-4a25-915f-ab114932109f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:45.611595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b27de-9bca-43a3-a4ac-2d07fa658151 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:45.620525 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:45.670867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb713c-6e0f-4a25-915f-ab114932109f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:45.679740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf3898-621f-457b-ae9a-82b686c4d416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:45.680718 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf3898-621f-457b-ae9a-82b686c4d416 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:45.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf3898-621f-457b-ae9a-82b686c4d416 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:45.681771 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf3898-621f-457b-ae9a-82b686c4d416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:45.717636 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01b0a1-2294-49fc-892b-0312e2966fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:45.718448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01b0a1-2294-49fc-892b-0312e2966fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:45.718651 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01b0a1-2294-49fc-892b-0312e2966fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:45.718912 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01b0a1-2294-49fc-892b-0312e2966fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:45.719607 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01b0a1-2294-49fc-892b-0312e2966fb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:45.719897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01b0a1-2294-49fc-892b-0312e2966fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:45.721324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01b0a1-2294-49fc-892b-0312e2966fb7 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:45.723683 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:45.736233 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 214/431] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:41:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:45.744197 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01b0a1-2294-49fc-892b-0312e2966fb7 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:45.764945 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf3898-621f-457b-ae9a-82b686c4d416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:45.766553 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf3898-621f-457b-ae9a-82b686c4d416 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:45.878319 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01b0a1-2294-49fc-892b-0312e2966fb7 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:45.906839 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 218/432] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:45.915571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf3898-621f-457b-ae9a-82b686c4d416 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:45.938082 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95c083-1bac-49a3-a87d-421c48bf6c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:45.938695 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95c083-1bac-49a3-a87d-421c48bf6c7a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:45.938984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95c083-1bac-49a3-a87d-421c48bf6c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:45.939255 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95c083-1bac-49a3-a87d-421c48bf6c7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:45.950461 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:45.994437 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:46.025195 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95c083-1bac-49a3-a87d-421c48bf6c7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:46.028508 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95c083-1bac-49a3-a87d-421c48bf6c7a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:46.041490 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf3898-621f-457b-ae9a-82b686c4d416 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:46.081150 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f1186-ef15-4d62-afe5-133967f46620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:46.081768 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f1186-ef15-4d62-afe5-133967f46620 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:46.082047 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f1186-ef15-4d62-afe5-133967f46620 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:46.082318 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f1186-ef15-4d62-afe5-133967f46620 None admin] PATH_INFO: `/v3/projects/106df7e3199d4f9896aebc029a0becf3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:46.083441 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f1186-ef15-4d62-afe5-133967f46620 None admin] RBAC: Authorizing `identity:get_project(project_id=106df7e3199d4f9896aebc029a0becf3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:46.084907 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f1186-ef15-4d62-afe5-133967f46620 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:46.086509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 219/433] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:45 2022] GET /identity/v3/projects/106df7e3199d4f9896aebc029a0becf3 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:46.087614 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a07a-d8e8-4236-af58-92d4abfc1e56 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:46.087891 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a07a-d8e8-4236-af58-92d4abfc1e56 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:46.088145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a07a-d8e8-4236-af58-92d4abfc1e56 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:46.089353 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 220/434] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:46.097555 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33a07a-d8e8-4236-af58-92d4abfc1e56 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:46.169012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 215/435] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:41:46.171030 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c025f0-fa59-4533-a5ad-b37dfaf3e457 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:46.171459 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c025f0-fa59-4533-a5ad-b37dfaf3e457 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:46.172210 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c025f0-fa59-4533-a5ad-b37dfaf3e457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:46.194057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-79c025f0-fa59-4533-a5ad-b37dfaf3e457 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:46.195300 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-79c025f0-fa59-4533-a5ad-b37dfaf3e457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:46.228267 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:46.232173 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33a07a-d8e8-4236-af58-92d4abfc1e56 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:46.267252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddbfe4-7c87-408c-ab4e-452b38495829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:46.267884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddbfe4-7c87-408c-ab4e-452b38495829 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:46.268163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddbfe4-7c87-408c-ab4e-452b38495829 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:46.268591 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddbfe4-7c87-408c-ab4e-452b38495829 None admin] PATH_INFO: `/v3/groups/d314c559443e4814b243686bda3f6ff4` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:46.269601 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddbfe4-7c87-408c-ab4e-452b38495829 None admin] RBAC: Authorizing `identity:get_group(group_id=d314c559443e4814b243686bda3f6ff4)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:46.271039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddbfe4-7c87-408c-ab4e-452b38495829 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:46.280969 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 221/436] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:46 2022] GET /identity/v3/groups/d314c559443e4814b243686bda3f6ff4 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:46.281131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 216/437] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:46.281221 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddbfe4-7c87-408c-ab4e-452b38495829 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:46.281835 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c025f0-fa59-4533-a5ad-b37dfaf3e457 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:46.283278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:46.387698 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddbfe4-7c87-408c-ab4e-452b38495829 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:46.395807 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c025f0-fa59-4533-a5ad-b37dfaf3e457 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:46.424276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cfbb4-75e2-4926-babf-567bbf5c8f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:46.424878 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cfbb4-75e2-4926-babf-567bbf5c8f13 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:46.425156 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cfbb4-75e2-4926-babf-567bbf5c8f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:46.425432 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cfbb4-75e2-4926-babf-567bbf5c8f13 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:46.426555 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cfbb4-75e2-4926-babf-567bbf5c8f13 None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:46.428003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cfbb4-75e2-4926-babf-567bbf5c8f13 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:46.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 222/438] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:46 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:46.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469d137-5996-42e1-abde-9ca151b690d5 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:46.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469d137-5996-42e1-abde-9ca151b690d5 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:46.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469d137-5996-42e1-abde-9ca151b690d5 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:46.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 223/439] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:46.435111 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469d137-5996-42e1-abde-9ca151b690d5 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:46.437511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee535b2-ae72-417c-9b3c-c10cbdac6d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:46.438351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee535b2-ae72-417c-9b3c-c10cbdac6d4e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:46.438750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee535b2-ae72-417c-9b3c-c10cbdac6d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:46.439028 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee535b2-ae72-417c-9b3c-c10cbdac6d4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:46.439769 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee535b2-ae72-417c-9b3c-c10cbdac6d4e None admin] RBAC: Adding query filter params (group.id=d314c559443e4814b243686bda3f6ff4, role.id=3ebdb28c195f447294810f1033bb8e62, scope.project.id=106df7e3199d4f9896aebc029a0becf3) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:46.440083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee535b2-ae72-417c-9b3c-c10cbdac6d4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:46.441549 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee535b2-ae72-417c-9b3c-c10cbdac6d4e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:46.447524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 217/440] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Sep 25 00:41:46 2022] GET /identity/v3/role_assignments?group.id=d314c559443e4814b243686bda3f6ff4&scope.project.id=106df7e3199d4f9896aebc029a0becf3&role.id=3ebdb28c195f447294810f1033bb8e62 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:46.449035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56ec0-8af1-48f1-a4ea-954e931884e1 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:46.449321 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56ec0-8af1-48f1-a4ea-954e931884e1 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:46.449594 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56ec0-8af1-48f1-a4ea-954e931884e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:46.470618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-33a56ec0-8af1-48f1-a4ea-954e931884e1 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:46.472665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-33a56ec0-8af1-48f1-a4ea-954e931884e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:46.508956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:46.533363 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:46.562017 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 218/441] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:46.563524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a56ec0-8af1-48f1-a4ea-954e931884e1 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:46.571129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469d137-5996-42e1-abde-9ca151b690d5 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:46.612794 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7519e-1546-426b-89b5-6d513b68425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:46.613696 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7519e-1546-426b-89b5-6d513b68425e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:46.613975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7519e-1546-426b-89b5-6d513b68425e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:46.614247 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7519e-1546-426b-89b5-6d513b68425e None admin] PATH_INFO: `/v3/groups/d314c559443e4814b243686bda3f6ff4` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:46.615408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7519e-1546-426b-89b5-6d513b68425e None admin] RBAC: Authorizing `identity:get_group(group_id=d314c559443e4814b243686bda3f6ff4)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:46.618523 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7519e-1546-426b-89b5-6d513b68425e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:46.624094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 224/442] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:46 2022] GET /identity/v3/groups/d314c559443e4814b243686bda3f6ff4 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:46.625003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7519e-1546-426b-89b5-6d513b68425e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:46.692888 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a56ec0-8af1-48f1-a4ea-954e931884e1 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:46.742858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d870179-0310-4ec9-9232-d50dd79cd040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:46.743552 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d870179-0310-4ec9-9232-d50dd79cd040 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:46.743834 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d870179-0310-4ec9-9232-d50dd79cd040 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:46.744107 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d870179-0310-4ec9-9232-d50dd79cd040 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:46.761153 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d870179-0310-4ec9-9232-d50dd79cd040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:46.761414 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7519e-1546-426b-89b5-6d513b68425e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-2d870179-0310-4ec9-9232-d50dd79cd040 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:46.767093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:46.767999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:46.768803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:46.768803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:46.768803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:46.768803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:46.768803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:46.768803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:46.768803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:46.768803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:46.768803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:46.768803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:46.768803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:46.768803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:46.773890 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 219/443] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:41:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:46.775041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d870179-0310-4ec9-9232-d50dd79cd040 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:46.803972 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14612829-e3b2-4ae7-8232-a57a03c4f7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:46.804611 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14612829-e3b2-4ae7-8232-a57a03c4f7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:46.804899 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14612829-e3b2-4ae7-8232-a57a03c4f7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:46.805173 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14612829-e3b2-4ae7-8232-a57a03c4f7d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:46.805900 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14612829-e3b2-4ae7-8232-a57a03c4f7d3 None admin] RBAC: Adding query filter params (group.id=d314c559443e4814b243686bda3f6ff4, role.id=eab9c0818aa3414eb3a1a155830ad262, scope.project.id=1c228a61fd2544379846b2c8a69fd2c3) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:46.806208 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14612829-e3b2-4ae7-8232-a57a03c4f7d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:46.806869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:46.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14612829-e3b2-4ae7-8232-a57a03c4f7d3 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:46.815830 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 225/444] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Sep 25 00:41:46 2022] GET /identity/v3/role_assignments?group.id=d314c559443e4814b243686bda3f6ff4&scope.project.id=1c228a61fd2544379846b2c8a69fd2c3&role.id=eab9c0818aa3414eb3a1a155830ad262 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:46.846967 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14612829-e3b2-4ae7-8232-a57a03c4f7d3 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:46.853449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:46.923479 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d870179-0310-4ec9-9232-d50dd79cd040 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:46.968129 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b790f32-39c1-414e-856a-61f504c38ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:46.968805 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b790f32-39c1-414e-856a-61f504c38ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:46.969056 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b790f32-39c1-414e-856a-61f504c38ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:46.969625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b790f32-39c1-414e-856a-61f504c38ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:46.970318 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b790f32-39c1-414e-856a-61f504c38ba8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:46.970956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b790f32-39c1-414e-856a-61f504c38ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:46.972343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b790f32-39c1-414e-856a-61f504c38ba8 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:46.981722 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 220/445] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:46.987779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b790f32-39c1-414e-856a-61f504c38ba8 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:46.998941 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14612829-e3b2-4ae7-8232-a57a03c4f7d3 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:47.040033 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd93a7-27d4-47a3-922c-21d7f14e5835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:47.040702 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd93a7-27d4-47a3-922c-21d7f14e5835 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:47.041244 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd93a7-27d4-47a3-922c-21d7f14e5835 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:47.041539 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd93a7-27d4-47a3-922c-21d7f14e5835 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:47.053569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd93a7-27d4-47a3-922c-21d7f14e5835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-4ddd93a7-27d4-47a3-922c-21d7f14e5835 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:47.058886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:47.059803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:47.061272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:47.061272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:47.061272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:47.061272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:47.061272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:47.061272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:47.061272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:47.061272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:47.061272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:47.061272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:47.061272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:41:47.061272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:47.061272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 226/446] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:41:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:47.066293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd93a7-27d4-47a3-922c-21d7f14e5835 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:47.090769 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:47.109196 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b790f32-39c1-414e-856a-61f504c38ba8 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:47.135586 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:47.148990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401efef0-a93a-4b69-87c7-71193eb9eba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:47.149606 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401efef0-a93a-4b69-87c7-71193eb9eba2 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:47.149884 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401efef0-a93a-4b69-87c7-71193eb9eba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:47.150362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401efef0-a93a-4b69-87c7-71193eb9eba2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:47.176146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd93a7-27d4-47a3-922c-21d7f14e5835 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:47.215327 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bc034-7407-4835-a502-fe97ee8d416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:47.216585 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bc034-7407-4835-a502-fe97ee8d416a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:47.217119 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bc034-7407-4835-a502-fe97ee8d416a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:47.217557 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bc034-7407-4835-a502-fe97ee8d416a None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:47.218607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bc034-7407-4835-a502-fe97ee8d416a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:47.218872 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bc034-7407-4835-a502-fe97ee8d416a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:47.220391 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bc034-7407-4835-a502-fe97ee8d416a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:47.228469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 227/447] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:47.230213 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401efef0-a93a-4b69-87c7-71193eb9eba2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:47.231752 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401efef0-a93a-4b69-87c7-71193eb9eba2 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:47.234586 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bc034-7407-4835-a502-fe97ee8d416a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:47.314084 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:47.330335 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 221/448] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:41:47.332690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bc034-7407-4835-a502-fe97ee8d416a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:47.335857 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401efef0-a93a-4b69-87c7-71193eb9eba2 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:47.358264 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:47.367363 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dd9e7-37bd-4df1-9fc5-d731a3b34397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:47.367968 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dd9e7-37bd-4df1-9fc5-d731a3b34397 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:47.368253 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dd9e7-37bd-4df1-9fc5-d731a3b34397 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:47.368604 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dd9e7-37bd-4df1-9fc5-d731a3b34397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:47.430929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401efef0-a93a-4b69-87c7-71193eb9eba2 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:47.432920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dd9e7-37bd-4df1-9fc5-d731a3b34397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:47.434370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dd9e7-37bd-4df1-9fc5-d731a3b34397 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:47.463580 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c33cd-2648-408c-a6e1-afee4fe673c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:47.464199 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c33cd-2648-408c-a6e1-afee4fe673c8 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:47.464478 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c33cd-2648-408c-a6e1-afee4fe673c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:47.464772 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c33cd-2648-408c-a6e1-afee4fe673c8 None admin] PATH_INFO: `/v3/projects/1c228a61fd2544379846b2c8a69fd2c3` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:47.465886 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c33cd-2648-408c-a6e1-afee4fe673c8 None admin] RBAC: Authorizing `identity:get_project(project_id=1c228a61fd2544379846b2c8a69fd2c3)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:47.467838 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c33cd-2648-408c-a6e1-afee4fe673c8 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:47.469590 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 222/449] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:47 2022] GET /identity/v3/projects/1c228a61fd2544379846b2c8a69fd2c3 => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:47.474881 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c33cd-2648-408c-a6e1-afee4fe673c8 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:47.525754 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:47.531857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 228/450] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:41:47.537346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dd9e7-37bd-4df1-9fc5-d731a3b34397 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:47.562488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:47.576104 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c33cd-2648-408c-a6e1-afee4fe673c8 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:47.609636 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0b466-c856-4b19-908c-82fc9271d024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:47.610263 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0b466-c856-4b19-908c-82fc9271d024 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:47.610563 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0b466-c856-4b19-908c-82fc9271d024 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:47.610832 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0b466-c856-4b19-908c-82fc9271d024 None admin] PATH_INFO: `/v3/groups/d314c559443e4814b243686bda3f6ff4` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:47.611943 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0b466-c856-4b19-908c-82fc9271d024 None admin] RBAC: Authorizing `identity:get_group(group_id=d314c559443e4814b243686bda3f6ff4)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:47.613407 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0b466-c856-4b19-908c-82fc9271d024 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:47.615130 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 223/451] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:47 2022] GET /identity/v3/groups/d314c559443e4814b243686bda3f6ff4 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:47.620760 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0b466-c856-4b19-908c-82fc9271d024 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:47.635551 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dd9e7-37bd-4df1-9fc5-d731a3b34397 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:47.670505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf56df-4f77-4869-a720-0f8fe626a9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:47.671125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf56df-4f77-4869-a720-0f8fe626a9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:47.671401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf56df-4f77-4869-a720-0f8fe626a9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:47.671671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf56df-4f77-4869-a720-0f8fe626a9b5 None admin] PATH_INFO: `/v3/projects/d20cd80763f84ad5bcde9f24ede790c8` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:47.672798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf56df-4f77-4869-a720-0f8fe626a9b5 None admin] RBAC: Authorizing `identity:get_project(project_id=d20cd80763f84ad5bcde9f24ede790c8)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:47.674233 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf56df-4f77-4869-a720-0f8fe626a9b5 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:47.675815 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 229/452] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:41:47 2022] GET /identity/v3/projects/d20cd80763f84ad5bcde9f24ede790c8 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:47.681101 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf56df-4f77-4869-a720-0f8fe626a9b5 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:47.725410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0b466-c856-4b19-908c-82fc9271d024 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:47.744514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:47.758466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664e30c-97b6-464d-8ed8-dcd9c3b3b484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:47.759059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664e30c-97b6-464d-8ed8-dcd9c3b3b484 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:47.759339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664e30c-97b6-464d-8ed8-dcd9c3b3b484 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:47.759609 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664e30c-97b6-464d-8ed8-dcd9c3b3b484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:47.760315 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664e30c-97b6-464d-8ed8-dcd9c3b3b484 None admin] RBAC: Adding query filter params (group.id=d314c559443e4814b243686bda3f6ff4, role.id=3ebdb28c195f447294810f1033bb8e62, scope.project.id=1c228a61fd2544379846b2c8a69fd2c3) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:47.760648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664e30c-97b6-464d-8ed8-dcd9c3b3b484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:47.762169 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664e30c-97b6-464d-8ed8-dcd9c3b3b484 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:47.768265 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 224/453] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Sep 25 00:41:47 2022] GET /identity/v3/role_assignments?group.id=d314c559443e4814b243686bda3f6ff4&scope.project.id=1c228a61fd2544379846b2c8a69fd2c3&role.id=3ebdb28c195f447294810f1033bb8e62 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:47.774368 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:47.782641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf56df-4f77-4869-a720-0f8fe626a9b5 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:47.818705 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c426980-8fe3-465b-96a3-56a4b357f6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:47.819726 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c426980-8fe3-465b-96a3-56a4b357f6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:47.820021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c426980-8fe3-465b-96a3-56a4b357f6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:47.820303 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c426980-8fe3-465b-96a3-56a4b357f6c1 None admin] PATH_INFO: `/v3/groups/cf1a04465e1a4774b6e3e5fad1a23182` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:47.821600 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c426980-8fe3-465b-96a3-56a4b357f6c1 None admin] RBAC: Authorizing `identity:get_group(group_id=cf1a04465e1a4774b6e3e5fad1a23182)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:47.823371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c426980-8fe3-465b-96a3-56a4b357f6c1 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:47.825435 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 230/454] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Sep 25 00:41:47 2022] GET /identity/v3/groups/cf1a04465e1a4774b6e3e5fad1a23182 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:41:47.831770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664e30c-97b6-464d-8ed8-dcd9c3b3b484 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:47.936873 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664e30c-97b6-464d-8ed8-dcd9c3b3b484 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:47.972932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec407f-0164-4b57-96cc-d307bdf7bb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:47.973531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec407f-0164-4b57-96cc-d307bdf7bb34 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:47.973811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec407f-0164-4b57-96cc-d307bdf7bb34 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:47.974233 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec407f-0164-4b57-96cc-d307bdf7bb34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:47.974967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec407f-0164-4b57-96cc-d307bdf7bb34 None admin] RBAC: Adding query filter params (group.id=cf1a04465e1a4774b6e3e5fad1a23182, role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=d20cd80763f84ad5bcde9f24ede790c8) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:47.975283 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec407f-0164-4b57-96cc-d307bdf7bb34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:47.976797 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec407f-0164-4b57-96cc-d307bdf7bb34 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:47.983352 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 225/455] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Sep 25 00:41:47 2022] GET /identity/v3/role_assignments?group.id=cf1a04465e1a4774b6e3e5fad1a23182&scope.project.id=d20cd80763f84ad5bcde9f24ede790c8&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:50.591185 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926fab5-1be1-4da4-89cf-f18232f31450 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:50.592204 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926fab5-1be1-4da4-89cf-f18232f31450 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:50.592733 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926fab5-1be1-4da4-89cf-f18232f31450 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:50.594588 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 231/456] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:50.599717 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cf6a5-8957-48f6-939b-af3fa9dc6744 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:50.600591 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cf6a5-8957-48f6-939b-af3fa9dc6744 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:50.601060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cf6a5-8957-48f6-939b-af3fa9dc6744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:50.619464 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-566cf6a5-8957-48f6-939b-af3fa9dc6744 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:50.625739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-566cf6a5-8957-48f6-939b-af3fa9dc6744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:50.680983 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:50.712619 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 226/457] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:51.065557 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926fab5-1be1-4da4-89cf-f18232f31450 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:51.097819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df82c-18d2-40bb-874f-5e8dbd399d00 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:51.098477 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df82c-18d2-40bb-874f-5e8dbd399d00 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:51.099253 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df82c-18d2-40bb-874f-5e8dbd399d00 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:51.101238 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 227/458] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:51.111657 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065223-c1e9-437f-af6c-4e135852f57d None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:51.112232 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065223-c1e9-437f-af6c-4e135852f57d None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:51.112766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065223-c1e9-437f-af6c-4e135852f57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:51.140131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-0f065223-c1e9-437f-af6c-4e135852f57d None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:51.143225 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-0f065223-c1e9-437f-af6c-4e135852f57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:51.237707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926fab5-1be1-4da4-89cf-f18232f31450 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:51.243941 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 228/459] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 25 00:41:51.245639 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be00242-e8d5-40f1-9c41-438ded20fa01 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:51.246071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be00242-e8d5-40f1-9c41-438ded20fa01 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:51.246549 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be00242-e8d5-40f1-9c41-438ded20fa01 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:51.248021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 229/460] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:51.253489 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e965f-efac-44cc-9d05-cdc20f68dc80 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:51.254040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e965f-efac-44cc-9d05-cdc20f68dc80 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:51.254516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e965f-efac-44cc-9d05-cdc20f68dc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:51.272344 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-1b4e965f-efac-44cc-9d05-cdc20f68dc80 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:51.273908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-1b4e965f-efac-44cc-9d05-cdc20f68dc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:51.274015 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5c4fa-18a9-4769-aa47-b9279fc71e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:51.274608 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5c4fa-18a9-4769-aa47-b9279fc71e1f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:51.275044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5c4fa-18a9-4769-aa47-b9279fc71e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:51.275455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5c4fa-18a9-4769-aa47-b9279fc71e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:51.286916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5c4fa-18a9-4769-aa47-b9279fc71e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:51.288581 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5c4fa-18a9-4769-aa47-b9279fc71e1f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-21a5c4fa-18a9-4769-aa47-b9279fc71e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:41:51.305041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:51.306125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:41:51.307162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:41:51.307162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:51.307162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:51.308849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 232/461] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:51.314963 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee50d6-7060-43a7-957c-ac3b3009f81d None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:51.315547 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee50d6-7060-43a7-957c-ac3b3009f81d None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:51.316137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee50d6-7060-43a7-957c-ac3b3009f81d None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:51.317602 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 233/462] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:51.318429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee50d6-7060-43a7-957c-ac3b3009f81d None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:51.335103 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:51.362373 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 230/463] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:51.363988 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a9f45-410a-4a21-bcfa-d1dae38f2019 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:51.364476 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a9f45-410a-4a21-bcfa-d1dae38f2019 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:51.365134 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a9f45-410a-4a21-bcfa-d1dae38f2019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:51.383848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-fc3a9f45-410a-4a21-bcfa-d1dae38f2019 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:51.385665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-fc3a9f45-410a-4a21-bcfa-d1dae38f2019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:51.425757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee50d6-7060-43a7-957c-ac3b3009f81d None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:51.453520 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:51.461792 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b2d5a-e46c-4103-9df0-8e385aeaed32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:51.462400 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b2d5a-e46c-4103-9df0-8e385aeaed32 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:51.462674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b2d5a-e46c-4103-9df0-8e385aeaed32 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:51.462946 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b2d5a-e46c-4103-9df0-8e385aeaed32 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:51.463588 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b2d5a-e46c-4103-9df0-8e385aeaed32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:51.463888 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b2d5a-e46c-4103-9df0-8e385aeaed32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:51.465359 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b2d5a-e46c-4103-9df0-8e385aeaed32 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:51.488752 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 234/464] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:51.494669 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b2d5a-e46c-4103-9df0-8e385aeaed32 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:51.546783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 231/465] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:51.588992 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:51.593620 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a9f45-410a-4a21-bcfa-d1dae38f2019 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:51.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b2d5a-e46c-4103-9df0-8e385aeaed32 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:51.634933 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f5455-eb31-4c57-9db1-32e04a519bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:51.635534 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f5455-eb31-4c57-9db1-32e04a519bfc None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:51.635878 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f5455-eb31-4c57-9db1-32e04a519bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:51.636158 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f5455-eb31-4c57-9db1-32e04a519bfc None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:51.636894 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f5455-eb31-4c57-9db1-32e04a519bfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:51.638397 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f5455-eb31-4c57-9db1-32e04a519bfc None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:51.663813 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 235/466] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:41:51 2022] POST /identity/v3/users => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:41:51.745854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f5455-eb31-4c57-9db1-32e04a519bfc None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:51.802763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a9f45-410a-4a21-bcfa-d1dae38f2019 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:51.854942 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc4cc5-9d67-4c2b-a230-65a2ab32553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:51.855658 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc4cc5-9d67-4c2b-a230-65a2ab32553d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:51.856062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc4cc5-9d67-4c2b-a230-65a2ab32553d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:51.856441 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc4cc5-9d67-4c2b-a230-65a2ab32553d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:51.869718 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc4cc5-9d67-4c2b-a230-65a2ab32553d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:51.871335 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc4cc5-9d67-4c2b-a230-65a2ab32553d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:51.882498 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f5455-eb31-4c57-9db1-32e04a519bfc None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-b8dc4cc5-9d67-4c2b-a230-65a2ab32553d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:41:51.890150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:51.891067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:41:51.891898 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:41:51.891898 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:51.891898 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:51.893108 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 232/467] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:51.900289 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc4cc5-9d67-4c2b-a230-65a2ab32553d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:51.915889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:51.924822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d4978-1542-4bf9-a9db-1a6f161aa403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:51.925471 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d4978-1542-4bf9-a9db-1a6f161aa403 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:51.925748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d4978-1542-4bf9-a9db-1a6f161aa403 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:51.926023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d4978-1542-4bf9-a9db-1a6f161aa403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:51.933429 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:51.943896 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d4978-1542-4bf9-a9db-1a6f161aa403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:51.945493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d4978-1542-4bf9-a9db-1a6f161aa403 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-829d4978-1542-4bf9-a9db-1a6f161aa403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:41:51.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:51.965589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:41:51.967668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:41:51.967668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:51.967668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:51.967668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 236/468] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:41:51.967668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d4978-1542-4bf9-a9db-1a6f161aa403 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:52.038402 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc4cc5-9d67-4c2b-a230-65a2ab32553d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:52.079989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc580e8-4296-4575-931b-e403a8081b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:52.080981 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc580e8-4296-4575-931b-e403a8081b27 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:52.081522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc580e8-4296-4575-931b-e403a8081b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:52.081798 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc580e8-4296-4575-931b-e403a8081b27 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:52.082589 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc580e8-4296-4575-931b-e403a8081b27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:52.083037 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc580e8-4296-4575-931b-e403a8081b27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:52.085216 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc580e8-4296-4575-931b-e403a8081b27 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:52.088535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d4978-1542-4bf9-a9db-1a6f161aa403 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:52.099570 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 233/469] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:52.100679 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc580e8-4296-4575-931b-e403a8081b27 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:52.133975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85536dee-a87f-48be-aec5-753cdda64530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:52.134926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536dee-a87f-48be-aec5-753cdda64530 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:52.135273 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536dee-a87f-48be-aec5-753cdda64530 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:52.135617 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536dee-a87f-48be-aec5-753cdda64530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:52.149907 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85536dee-a87f-48be-aec5-753cdda64530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:52.151683 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85536dee-a87f-48be-aec5-753cdda64530 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-85536dee-a87f-48be-aec5-753cdda64530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:41:52.165724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:52.166656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:41:52.167505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:41:52.167505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:52.167505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:52.167505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 237/470] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:52.167941 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85536dee-a87f-48be-aec5-753cdda64530 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:52.195679 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:52.204518 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:52.217448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc580e8-4296-4575-931b-e403a8081b27 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:52.255152 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066497f-9326-4adb-b313-ad2ac108d0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:52.255761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066497f-9326-4adb-b313-ad2ac108d0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:52.256040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066497f-9326-4adb-b313-ad2ac108d0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:52.256314 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066497f-9326-4adb-b313-ad2ac108d0c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:52.256983 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066497f-9326-4adb-b313-ad2ac108d0c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:52.257289 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066497f-9326-4adb-b313-ad2ac108d0c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:52.258672 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066497f-9326-4adb-b313-ad2ac108d0c4 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:52.270225 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 234/471] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:52.271422 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16076d-8d9f-4a60-816a-0ad2b40311b8 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:52.271708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16076d-8d9f-4a60-816a-0ad2b40311b8 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:52.271987 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16076d-8d9f-4a60-816a-0ad2b40311b8 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:52.275136 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 235/472] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:52.275136 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16076d-8d9f-4a60-816a-0ad2b40311b8 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:52.287614 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85536dee-a87f-48be-aec5-753cdda64530 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:52.322221 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227784e-453d-45f8-8283-6cbf0fdf117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:52.323095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227784e-453d-45f8-8283-6cbf0fdf117c None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:52.323372 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227784e-453d-45f8-8283-6cbf0fdf117c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:52.323644 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227784e-453d-45f8-8283-6cbf0fdf117c None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:52.324292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227784e-453d-45f8-8283-6cbf0fdf117c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:52.325758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227784e-453d-45f8-8283-6cbf0fdf117c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:52.351598 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 238/473] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:41:52 2022] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:41:52.352765 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227784e-453d-45f8-8283-6cbf0fdf117c None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:52.393864 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16076d-8d9f-4a60-816a-0ad2b40311b8 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:52.433185 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd624c73-a443-4807-bb29-19314ff46d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:52.434254 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624c73-a443-4807-bb29-19314ff46d1b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:52.434758 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624c73-a443-4807-bb29-19314ff46d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:52.435234 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624c73-a443-4807-bb29-19314ff46d1b None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:52.436840 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd624c73-a443-4807-bb29-19314ff46d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:52.437380 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd624c73-a443-4807-bb29-19314ff46d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:52.439147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd624c73-a443-4807-bb29-19314ff46d1b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:52.450800 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:52.455202 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 236/474] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:52.457099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea425cfa-e6f8-4b7a-815a-9f524a6936a5 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:52.457683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea425cfa-e6f8-4b7a-815a-9f524a6936a5 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:52.458408 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea425cfa-e6f8-4b7a-815a-9f524a6936a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:52.487674 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-ea425cfa-e6f8-4b7a-815a-9f524a6936a5 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:52.489338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-ea425cfa-e6f8-4b7a-815a-9f524a6936a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:52.502064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227784e-453d-45f8-8283-6cbf0fdf117c None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:52.527341 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:52.548346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea79fde-6feb-4712-bedb-44c094a886ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:52.549006 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea79fde-6feb-4712-bedb-44c094a886ad None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:52.549284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea79fde-6feb-4712-bedb-44c094a886ad None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:52.549553 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea79fde-6feb-4712-bedb-44c094a886ad None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:52.550205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea79fde-6feb-4712-bedb-44c094a886ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:52.551640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea79fde-6feb-4712-bedb-44c094a886ad None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:52.578708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 239/475] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:41:52 2022] POST /identity/v3/users => generated 248 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:41:52.579598 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea79fde-6feb-4712-bedb-44c094a886ad None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:52.586468 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 237/476] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:52.710703 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea79fde-6feb-4712-bedb-44c094a886ad None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:52.753557 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5f048-49d2-4d13-b8bb-1ae0d8e613da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:52.754624 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5f048-49d2-4d13-b8bb-1ae0d8e613da None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:52.755154 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5f048-49d2-4d13-b8bb-1ae0d8e613da None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:52.755640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5f048-49d2-4d13-b8bb-1ae0d8e613da None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:52.756578 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5f048-49d2-4d13-b8bb-1ae0d8e613da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:52.758298 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5f048-49d2-4d13-b8bb-1ae0d8e613da None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:52.786842 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 240/477] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:41:52 2022] POST /identity/v3/users => generated 249 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:41:52.883657 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea425cfa-e6f8-4b7a-815a-9f524a6936a5 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:52.999620 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea425cfa-e6f8-4b7a-815a-9f524a6936a5 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:53.030102 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:53.038002 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb66bfe-ba16-4f24-955e-59cd337fe427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:53.038619 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb66bfe-ba16-4f24-955e-59cd337fe427 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:53.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb66bfe-ba16-4f24-955e-59cd337fe427 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:53.039175 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb66bfe-ba16-4f24-955e-59cd337fe427 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:53.039861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb66bfe-ba16-4f24-955e-59cd337fe427 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:53.041334 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb66bfe-ba16-4f24-955e-59cd337fe427 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:53.052329 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.sql.core [None req-6eb66bfe-ba16-4f24-955e-59cd337fe427 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 25 00:41:53.052329 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 25 00:41:53.052329 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [parameters: {'id': '014a90be1001426dad64f99d867818fb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 25 00:41:53.052329 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81371) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-6eb66bfe-ba16-4f24-955e-59cd337fe427 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application conn.query(q) Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application result.read() Sep 25 00:41:53.068878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return ref.to_dict() Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 00:41:53.069751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application next(self.gen) Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application yield resource Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application next(self.gen) Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.session.rollback() Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.force_reraise() Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise self.value Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application session.commit() Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 25 00:41:53.070896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._prepare_impl() Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.session.flush() Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._flush(objects) Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application compat.raise_( Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application flush_context.execute() Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rec.execute(self) Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 25 00:41:53.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 00:41:53.073228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application conn.query(q) Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application result.read() Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 00:41:53.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [parameters: {'id': '014a90be1001426dad64f99d867818fb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:53.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 25 00:41:53.076387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:53.077226 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 238/478] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Sep 25 00:41:52 2022] POST /identity/v3/roles => generated 144 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:53.077292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5f048-49d2-4d13-b8bb-1ae0d8e613da None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:53.084451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:53.228258 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5f048-49d2-4d13-b8bb-1ae0d8e613da None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:53.280308 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0d660-47aa-49cd-9e37-5cbf47028e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:53.280897 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0d660-47aa-49cd-9e37-5cbf47028e34 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:53.281174 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0d660-47aa-49cd-9e37-5cbf47028e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:53.281443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0d660-47aa-49cd-9e37-5cbf47028e34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:53.296235 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0d660-47aa-49cd-9e37-5cbf47028e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-f9d0d660-47aa-49cd-9e37-5cbf47028e34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:53.301501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:53.302418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:53.303770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:53.303770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:53.303770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:53.303770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:53.303770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:53.303770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:53.303770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:53.303770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:53.303770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:53.303770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:53.303770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:41:53.303770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:53.303770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 241/479] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:41:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:53.308417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb66bfe-ba16-4f24-955e-59cd337fe427 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:53.444511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb66bfe-ba16-4f24-955e-59cd337fe427 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:53.491835 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223f5b1-1d88-4b26-b9a3-c1e584c68d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:53.492444 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223f5b1-1d88-4b26-b9a3-c1e584c68d3e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:53.492750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223f5b1-1d88-4b26-b9a3-c1e584c68d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:53.493020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223f5b1-1d88-4b26-b9a3-c1e584c68d3e None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:53.493692 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223f5b1-1d88-4b26-b9a3-c1e584c68d3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:53.493997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223f5b1-1d88-4b26-b9a3-c1e584c68d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:53.495362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223f5b1-1d88-4b26-b9a3-c1e584c68d3e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:53.505515 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 239/480] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:54.285038 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01a70a-5987-41e9-b465-e6d64cdeb6a5 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:54.285557 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01a70a-5987-41e9-b465-e6d64cdeb6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:54.285857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01a70a-5987-41e9-b465-e6d64cdeb6a5 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:54.287341 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 242/481] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:54.298571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddefb1-b8c9-49e1-851a-f47ac3b06011 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:54.298982 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddefb1-b8c9-49e1-851a-f47ac3b06011 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:54.299150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddefb1-b8c9-49e1-851a-f47ac3b06011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:54.325579 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-6bddefb1-b8c9-49e1-851a-f47ac3b06011 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:54.327165 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-6bddefb1-b8c9-49e1-851a-f47ac3b06011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:54.394754 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:54.413518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 240/482] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:54.858576 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01a70a-5987-41e9-b465-e6d64cdeb6a5 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:54.939405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:55.002222 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01a70a-5987-41e9-b465-e6d64cdeb6a5 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:55.048466 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743c30-3a84-434b-817b-b1d91ace2f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:55.049122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743c30-3a84-434b-817b-b1d91ace2f81 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:55.049401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743c30-3a84-434b-817b-b1d91ace2f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:55.049678 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743c30-3a84-434b-817b-b1d91ace2f81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:55.061850 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc743c30-3a84-434b-817b-b1d91ace2f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-dc743c30-3a84-434b-817b-b1d91ace2f81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:55.066789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:55.067652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:55.068837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:55.068837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:55.068837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:55.068837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:55.068837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:55.068837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:55.068837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:55.068837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:55.068837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:55.068837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:55.068837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:41:55.068837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:55.068837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 243/483] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:41:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:55.075792 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddefb1-b8c9-49e1-851a-f47ac3b06011 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:55.229547 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddefb1-b8c9-49e1-851a-f47ac3b06011 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:55.275501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3576f4-9fc1-451b-84d9-483c3b5371f9 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:55.276133 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3576f4-9fc1-451b-84d9-483c3b5371f9 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:55.276671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3576f4-9fc1-451b-84d9-483c3b5371f9 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:55.278638 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 244/484] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:55.284615 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395171e0-00c7-41db-bffd-754708b699aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:55.285262 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395171e0-00c7-41db-bffd-754708b699aa None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:55.285543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395171e0-00c7-41db-bffd-754708b699aa None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:55.285818 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395171e0-00c7-41db-bffd-754708b699aa None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:55.286511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395171e0-00c7-41db-bffd-754708b699aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:55.286817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395171e0-00c7-41db-bffd-754708b699aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:55.287123 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1188b3c-5ef8-4ea4-8bf6-80f44a446c40 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:55.287929 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1188b3c-5ef8-4ea4-8bf6-80f44a446c40 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:55.288238 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395171e0-00c7-41db-bffd-754708b699aa None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:55.288641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1188b3c-5ef8-4ea4-8bf6-80f44a446c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:55.308125 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 241/485] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:41:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:55.314072 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395171e0-00c7-41db-bffd-754708b699aa None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:55.314925 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-c1188b3c-5ef8-4ea4-8bf6-80f44a446c40 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:55.316346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-c1188b3c-5ef8-4ea4-8bf6-80f44a446c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:55.404618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:55.420591 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 245/486] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:55.421493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a469d1-a09d-4851-9559-93bc7546d32e None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:55.421940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a469d1-a09d-4851-9559-93bc7546d32e None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:55.422339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a469d1-a09d-4851-9559-93bc7546d32e None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:55.427834 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 246/487] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:55.429129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fb190-13e6-4a1d-9498-bf2f81267e48 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:55.430097 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fb190-13e6-4a1d-9498-bf2f81267e48 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:55.431205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fb190-13e6-4a1d-9498-bf2f81267e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:55.472232 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395171e0-00c7-41db-bffd-754708b699aa None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:55.473551 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-6a3fb190-13e6-4a1d-9498-bf2f81267e48 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:55.474819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-6a3fb190-13e6-4a1d-9498-bf2f81267e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:55.516052 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facc49e-e7ab-4dea-a49c-90df5894684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:55.517795 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facc49e-e7ab-4dea-a49c-90df5894684d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:55.518530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facc49e-e7ab-4dea-a49c-90df5894684d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:55.518961 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facc49e-e7ab-4dea-a49c-90df5894684d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:55.544009 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facc49e-e7ab-4dea-a49c-90df5894684d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:55.548577 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facc49e-e7ab-4dea-a49c-90df5894684d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-4facc49e-e7ab-4dea-a49c-90df5894684d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:41:55.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:55.573211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:41:55.574104 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:41:55.574104 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:55.574104 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:55.576507 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 242/488] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:41:55.585740 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facc49e-e7ab-4dea-a49c-90df5894684d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:55.587159 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:55.624534 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 247/489] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:41:55.655273 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61672-fbb0-4199-a8ed-c61adf8d6c26 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:55.655555 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61672-fbb0-4199-a8ed-c61adf8d6c26 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:55.656602 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61672-fbb0-4199-a8ed-c61adf8d6c26 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:55.660691 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 248/490] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:55.666623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23025a5e-0ff8-4809-8eb9-f1c513c65bd3 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:55.666899 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23025a5e-0ff8-4809-8eb9-f1c513c65bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:55.667173 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23025a5e-0ff8-4809-8eb9-f1c513c65bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:55.687599 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-23025a5e-0ff8-4809-8eb9-f1c513c65bd3 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:55.688800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-23025a5e-0ff8-4809-8eb9-f1c513c65bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:55.788638 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 249/491] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:55.788638 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23025a5e-0ff8-4809-8eb9-f1c513c65bd3 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:55.790234 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:55.798231 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facc49e-e7ab-4dea-a49c-90df5894684d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:55.854494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf55d4-0d2c-4194-9c01-00a4b0b116f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:55.855107 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf55d4-0d2c-4194-9c01-00a4b0b116f6 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:55.855382 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf55d4-0d2c-4194-9c01-00a4b0b116f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:55.855653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf55d4-0d2c-4194-9c01-00a4b0b116f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:55.856299 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf55d4-0d2c-4194-9c01-00a4b0b116f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:55.856621 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf55d4-0d2c-4194-9c01-00a4b0b116f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:55.858583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf55d4-0d2c-4194-9c01-00a4b0b116f6 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:55.884466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 243/492] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:55.891848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf55d4-0d2c-4194-9c01-00a4b0b116f6 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:55.969042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23025a5e-0ff8-4809-8eb9-f1c513c65bd3 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:55.989965 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:56.005508 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf55d4-0d2c-4194-9c01-00a4b0b116f6 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:56.023257 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24800cdc-b6b9-4c53-8534-5a6866bcb177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:56.023890 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24800cdc-b6b9-4c53-8534-5a6866bcb177 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:56.024165 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24800cdc-b6b9-4c53-8534-5a6866bcb177 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:56.024722 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24800cdc-b6b9-4c53-8534-5a6866bcb177 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:56.038425 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24800cdc-b6b9-4c53-8534-5a6866bcb177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-24800cdc-b6b9-4c53-8534-5a6866bcb177 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:56.043562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:56.044787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:56.045769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:56.045769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:56.045769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:56.045769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:56.045769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:56.045769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:56.045769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:56.045769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:56.045769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:56.045769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:56.045769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:41:56.045769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:56.046454 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25207c20-0c56-40a1-842a-b0723014a698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:56.046454 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207c20-0c56-40a1-842a-b0723014a698 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:56.046454 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207c20-0c56-40a1-842a-b0723014a698 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:56.046454 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207c20-0c56-40a1-842a-b0723014a698 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:56.046702 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 250/493] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:41:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:56.050898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24800cdc-b6b9-4c53-8534-5a6866bcb177 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:56.054787 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25207c20-0c56-40a1-842a-b0723014a698 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:56.056251 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25207c20-0c56-40a1-842a-b0723014a698 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-25207c20-0c56-40a1-842a-b0723014a698 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:41:56.073027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:56.073957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:56.074866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:56.074866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:56.074866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:41:56.074866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:41:56.074866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:41:56.074866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:41:56.074866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:41:56.074866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:41:56.074866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:41:56.074866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:56.074866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 244/494] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Sep 25 00:41:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:56.075428 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25207c20-0c56-40a1-842a-b0723014a698 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:56.103414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:56.161729 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24800cdc-b6b9-4c53-8534-5a6866bcb177 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:56.195346 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25207c20-0c56-40a1-842a-b0723014a698 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:56.197833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b678b50-ab6e-43ab-bc19-74e0bc3e1fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:56.198464 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678b50-ab6e-43ab-bc19-74e0bc3e1fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:56.198743 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678b50-ab6e-43ab-bc19-74e0bc3e1fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:56.199007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678b50-ab6e-43ab-bc19-74e0bc3e1fe4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:56.209965 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b678b50-ab6e-43ab-bc19-74e0bc3e1fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-9b678b50-ab6e-43ab-bc19-74e0bc3e1fe4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:56.215145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:56.216007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:56.218155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:56.218155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:56.218155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:56.218155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:56.218155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:56.218155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:56.218155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:56.218155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:56.218155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:56.218155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:56.218155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:41:56.218155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:56.218155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 251/495] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:41:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:56.222283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b678b50-ab6e-43ab-bc19-74e0bc3e1fe4 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:56.234663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94bd7d-0783-4870-94c4-1ae2b7b143cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:56.235270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94bd7d-0783-4870-94c4-1ae2b7b143cc None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:56.235577 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94bd7d-0783-4870-94c4-1ae2b7b143cc None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:56.235829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94bd7d-0783-4870-94c4-1ae2b7b143cc None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:56.236489 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94bd7d-0783-4870-94c4-1ae2b7b143cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:56.236823 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94bd7d-0783-4870-94c4-1ae2b7b143cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:56.238215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94bd7d-0783-4870-94c4-1ae2b7b143cc None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:56.246586 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 245/496] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:41:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:56.247965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94bd7d-0783-4870-94c4-1ae2b7b143cc None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:56.252289 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:56.319681 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b678b50-ab6e-43ab-bc19-74e0bc3e1fe4 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:56.330659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:56.348637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94bd7d-0783-4870-94c4-1ae2b7b143cc None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:56.352962 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f530c7-ebea-49aa-b593-ebc9f5c67936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:56.353567 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f530c7-ebea-49aa-b593-ebc9f5c67936 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:56.353850 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f530c7-ebea-49aa-b593-ebc9f5c67936 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:56.354127 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f530c7-ebea-49aa-b593-ebc9f5c67936 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:56.354857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f530c7-ebea-49aa-b593-ebc9f5c67936 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:56.355171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f530c7-ebea-49aa-b593-ebc9f5c67936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:56.356648 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f530c7-ebea-49aa-b593-ebc9f5c67936 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:56.380859 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed336b8-ec75-437a-a949-2be2fa76ee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:56.381479 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed336b8-ec75-437a-a949-2be2fa76ee76 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:56.381758 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed336b8-ec75-437a-a949-2be2fa76ee76 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:56.382029 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed336b8-ec75-437a-a949-2be2fa76ee76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:56.392368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed336b8-ec75-437a-a949-2be2fa76ee76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:41:56.393100 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 252/497] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Sep 25 00:41:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:56.393916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f530c7-ebea-49aa-b593-ebc9f5c67936 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-8ed336b8-ec75-437a-a949-2be2fa76ee76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:41:56.397635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:56.398561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:56.401286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:56.401286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:56.401286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:56.401286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:56.401286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:41:56.401286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:41:56.401286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:41:56.401286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:41:56.401286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:41:56.401286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:41:56.401286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:41:56.401286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:56.401286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 246/498] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:41:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:56.401286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3c731-fabb-4edb-a0f0-6161d9a9a205 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:56.401988 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3c731-fabb-4edb-a0f0-6161d9a9a205 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:56.401988 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3c731-fabb-4edb-a0f0-6161d9a9a205 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:56.401988 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 247/499] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:41:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:41:56.404739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3c731-fabb-4edb-a0f0-6161d9a9a205 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:56.486409 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:56.498484 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f530c7-ebea-49aa-b593-ebc9f5c67936 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:56.502659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3c731-fabb-4edb-a0f0-6161d9a9a205 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:56.531549 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f294ed-330b-4470-8bb4-39d008aea7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:56.532156 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f294ed-330b-4470-8bb4-39d008aea7cc None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:56.532440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f294ed-330b-4470-8bb4-39d008aea7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:56.532745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f294ed-330b-4470-8bb4-39d008aea7cc None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:56.533414 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f294ed-330b-4470-8bb4-39d008aea7cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:56.533723 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f294ed-330b-4470-8bb4-39d008aea7cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:56.535121 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f294ed-330b-4470-8bb4-39d008aea7cc None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:56.535617 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca036a7b-26d7-47b6-8f3f-c6aedf7f8b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:56.536231 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca036a7b-26d7-47b6-8f3f-c6aedf7f8b80 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:56.536512 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca036a7b-26d7-47b6-8f3f-c6aedf7f8b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:56.536811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca036a7b-26d7-47b6-8f3f-c6aedf7f8b80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:56.542878 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 253/500] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:41:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:56.543658 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f294ed-330b-4470-8bb4-39d008aea7cc None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:56.549177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca036a7b-26d7-47b6-8f3f-c6aedf7f8b80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:56.550616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca036a7b-26d7-47b6-8f3f-c6aedf7f8b80 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:56.552776 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-ca036a7b-26d7-47b6-8f3f-c6aedf7f8b80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:41:56.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:56.567786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:41:56.568745 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:41:56.568745 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:56.568745 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:56.568745 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 248/501] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:56.568745 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca036a7b-26d7-47b6-8f3f-c6aedf7f8b80 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:56.645484 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f294ed-330b-4470-8bb4-39d008aea7cc None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:56.664504 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca036a7b-26d7-47b6-8f3f-c6aedf7f8b80 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:56.679883 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db81698-aaa6-48f8-92c2-812d571d3e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:56.680917 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db81698-aaa6-48f8-92c2-812d571d3e6d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:56.681306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db81698-aaa6-48f8-92c2-812d571d3e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:56.681733 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db81698-aaa6-48f8-92c2-812d571d3e6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:56.698122 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f8d88-10c0-429c-a897-dc196c2f6ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:56.698719 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f8d88-10c0-429c-a897-dc196c2f6ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:56.699005 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f8d88-10c0-429c-a897-dc196c2f6ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:56.699277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f8d88-10c0-429c-a897-dc196c2f6ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:56.699933 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f8d88-10c0-429c-a897-dc196c2f6ef2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:56.700237 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f8d88-10c0-429c-a897-dc196c2f6ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:56.701677 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f8d88-10c0-429c-a897-dc196c2f6ef2 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:56.705026 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:56.709514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 249/502] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:41:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:56.710750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac30cf-f697-447e-9684-b85eb7c64efe None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:56.711039 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac30cf-f697-447e-9684-b85eb7c64efe None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:56.711309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac30cf-f697-447e-9684-b85eb7c64efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:56.729616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-fbac30cf-f697-447e-9684-b85eb7c64efe None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:41:56.730875 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-fbac30cf-f697-447e-9684-b85eb7c64efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:41:56.760807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db81698-aaa6-48f8-92c2-812d571d3e6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:56.762196 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db81698-aaa6-48f8-92c2-812d571d3e6d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:56.783761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:56.800791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 250/503] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:41:56.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac30cf-f697-447e-9684-b85eb7c64efe None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:56.871222 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 254/504] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:56.872265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db81698-aaa6-48f8-92c2-812d571d3e6d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:56.910894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac30cf-f697-447e-9684-b85eb7c64efe None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:56.930871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:56.945816 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ff838-bd3f-4d69-8afa-8689e8bf3e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:56.946438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff838-bd3f-4d69-8afa-8689e8bf3e63 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:56.946709 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff838-bd3f-4d69-8afa-8689e8bf3e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:56.946979 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff838-bd3f-4d69-8afa-8689e8bf3e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:56.957062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ff838-bd3f-4d69-8afa-8689e8bf3e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:56.958506 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ff838-bd3f-4d69-8afa-8689e8bf3e63 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-988ff838-bd3f-4d69-8afa-8689e8bf3e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:41:56.972524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:56.973414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:41:56.974243 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:41:56.974243 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:56.974243 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:56.974243 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 251/505] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:56.974456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ff838-bd3f-4d69-8afa-8689e8bf3e63 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:56.991186 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db81698-aaa6-48f8-92c2-812d571d3e6d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:57.018295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:57.025450 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf3af7-4ab0-40b8-92d6-bc157c5cbdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:57.026031 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf3af7-4ab0-40b8-92d6-bc157c5cbdac None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:57.026308 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf3af7-4ab0-40b8-92d6-bc157c5cbdac None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:57.026649 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf3af7-4ab0-40b8-92d6-bc157c5cbdac None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:57.027285 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf3af7-4ab0-40b8-92d6-bc157c5cbdac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:57.027507 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf3af7-4ab0-40b8-92d6-bc157c5cbdac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:57.029416 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf3af7-4ab0-40b8-92d6-bc157c5cbdac None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:57.041245 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 255/506] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:57.042046 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf3af7-4ab0-40b8-92d6-bc157c5cbdac None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:57.084247 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ff838-bd3f-4d69-8afa-8689e8bf3e63 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:57.119780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c962e-f059-4700-9514-bdb3b0f1e687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:57.120408 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c962e-f059-4700-9514-bdb3b0f1e687 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:57.121013 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c962e-f059-4700-9514-bdb3b0f1e687 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:57.121295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c962e-f059-4700-9514-bdb3b0f1e687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:57.131475 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c962e-f059-4700-9514-bdb3b0f1e687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:57.132938 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c962e-f059-4700-9514-bdb3b0f1e687 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:57.141405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf3af7-4ab0-40b8-92d6-bc157c5cbdac None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-454c962e-f059-4700-9514-bdb3b0f1e687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:41:57.146573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:57.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:41:57.148404 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:41:57.148404 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:57.148404 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:57.148404 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 252/507] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:57.148404 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c962e-f059-4700-9514-bdb3b0f1e687 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:57.157290 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:57.178077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e0c60-0c43-4fca-83ae-499efd269788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:57.178703 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e0c60-0c43-4fca-83ae-499efd269788 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:57.178991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e0c60-0c43-4fca-83ae-499efd269788 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:57.179267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e0c60-0c43-4fca-83ae-499efd269788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:57.189849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e0c60-0c43-4fca-83ae-499efd269788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:57.191315 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e0c60-0c43-4fca-83ae-499efd269788 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-a99e0c60-0c43-4fca-83ae-499efd269788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:41:57.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:57.206277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:41:57.207100 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:41:57.207100 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:57.207100 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:57.207100 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 256/508] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:57.207315 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e0c60-0c43-4fca-83ae-499efd269788 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:57.242274 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:57.251794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c962e-f059-4700-9514-bdb3b0f1e687 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:57.284860 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72b560-51f8-4b33-aed7-7803f7505997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:57.285387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72b560-51f8-4b33-aed7-7803f7505997 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:57.285663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72b560-51f8-4b33-aed7-7803f7505997 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:57.285932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72b560-51f8-4b33-aed7-7803f7505997 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:57.286562 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72b560-51f8-4b33-aed7-7803f7505997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:57.286860 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72b560-51f8-4b33-aed7-7803f7505997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:57.288209 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72b560-51f8-4b33-aed7-7803f7505997 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:57.300161 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 253/509] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:57.300971 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72b560-51f8-4b33-aed7-7803f7505997 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:57.312159 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e0c60-0c43-4fca-83ae-499efd269788 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:57.345534 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070440a-a1f4-4fc0-a2b8-406f4c26896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:57.346254 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070440a-a1f4-4fc0-a2b8-406f4c26896e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:57.346433 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070440a-a1f4-4fc0-a2b8-406f4c26896e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:57.346708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070440a-a1f4-4fc0-a2b8-406f4c26896e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:57.354194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070440a-a1f4-4fc0-a2b8-406f4c26896e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:57.355672 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070440a-a1f4-4fc0-a2b8-406f4c26896e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-c070440a-a1f4-4fc0-a2b8-406f4c26896e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:41:57.368364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:57.369449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:57.370309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:57.370309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:57.370309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:41:57.370309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:41:57.370309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:41:57.370309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:41:57.370309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:41:57.370309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:41:57.370309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:41:57.370309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:57.370309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 257/510] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:57.370856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070440a-a1f4-4fc0-a2b8-406f4c26896e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:57.396717 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:57.401178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72b560-51f8-4b33-aed7-7803f7505997 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:57.435012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc751519-f12c-4ecc-b121-c1239c5bc121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:57.435635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc751519-f12c-4ecc-b121-c1239c5bc121 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:57.435913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc751519-f12c-4ecc-b121-c1239c5bc121 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:57.436186 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc751519-f12c-4ecc-b121-c1239c5bc121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:57.445956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc751519-f12c-4ecc-b121-c1239c5bc121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:57.447660 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc751519-f12c-4ecc-b121-c1239c5bc121 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-dc751519-f12c-4ecc-b121-c1239c5bc121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:41:57.462469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:57.463490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:41:57.464315 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:41:57.464315 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:57.464315 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:57.464315 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 254/511] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:57.464315 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc751519-f12c-4ecc-b121-c1239c5bc121 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:57.467299 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:57.475097 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070440a-a1f4-4fc0-a2b8-406f4c26896e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:57.508036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd94f88-a67d-4f95-9714-6f17ef9ee102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:57.508680 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd94f88-a67d-4f95-9714-6f17ef9ee102 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:57.508958 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd94f88-a67d-4f95-9714-6f17ef9ee102 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:57.509231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd94f88-a67d-4f95-9714-6f17ef9ee102 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:57.509864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd94f88-a67d-4f95-9714-6f17ef9ee102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:57.510163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd94f88-a67d-4f95-9714-6f17ef9ee102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:57.511545 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd94f88-a67d-4f95-9714-6f17ef9ee102 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:57.523466 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 258/512] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:57.524345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd94f88-a67d-4f95-9714-6f17ef9ee102 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:57.565068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc751519-f12c-4ecc-b121-c1239c5bc121 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:57.599020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908c727-808b-4547-ae62-c4ac1e171aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:57.599626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908c727-808b-4547-ae62-c4ac1e171aec None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:57.599904 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908c727-808b-4547-ae62-c4ac1e171aec None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:57.600180 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908c727-808b-4547-ae62-c4ac1e171aec None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:57.600853 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908c727-808b-4547-ae62-c4ac1e171aec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:57.601158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908c727-808b-4547-ae62-c4ac1e171aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:57.602528 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908c727-808b-4547-ae62-c4ac1e171aec None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:57.606681 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:57.613856 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 255/513] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:57.614648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908c727-808b-4547-ae62-c4ac1e171aec None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:57.627909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd94f88-a67d-4f95-9714-6f17ef9ee102 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:57.662173 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7c39c-ec08-4353-ba30-e24d5a576b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:57.662788 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7c39c-ec08-4353-ba30-e24d5a576b3c None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:57.663063 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7c39c-ec08-4353-ba30-e24d5a576b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:57.663333 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7c39c-ec08-4353-ba30-e24d5a576b3c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:57.670033 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7c39c-ec08-4353-ba30-e24d5a576b3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:57.671455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7c39c-ec08-4353-ba30-e24d5a576b3c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:57.673396 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-c2d7c39c-ec08-4353-ba30-e24d5a576b3c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:41:57.682671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:57.683595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:57.684473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:57.684473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:57.684473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:41:57.684473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:41:57.684473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:41:57.684473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:41:57.684473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:41:57.684473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:41:57.684473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 25 00:41:57.684473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:57.684473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 259/514] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:41:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:57.684473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7c39c-ec08-4353-ba30-e24d5a576b3c None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:57.714061 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908c727-808b-4547-ae62-c4ac1e171aec None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:57.747300 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229609ea-53ee-4459-80a9-45bd12bf82b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:57.747937 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229609ea-53ee-4459-80a9-45bd12bf82b4 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:57.748216 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229609ea-53ee-4459-80a9-45bd12bf82b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:57.748488 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229609ea-53ee-4459-80a9-45bd12bf82b4 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:57.749241 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229609ea-53ee-4459-80a9-45bd12bf82b4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:57.749547 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229609ea-53ee-4459-80a9-45bd12bf82b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:57.750972 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229609ea-53ee-4459-80a9-45bd12bf82b4 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:57.787521 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7c39c-ec08-4353-ba30-e24d5a576b3c None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:57.788485 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 256/515] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Sep 25 00:41:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:57.789334 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229609ea-53ee-4459-80a9-45bd12bf82b4 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:57.825486 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bd1fd-8936-4e75-bdaf-0c7254650e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:57.826693 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bd1fd-8936-4e75-bdaf-0c7254650e43 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:57.826973 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bd1fd-8936-4e75-bdaf-0c7254650e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:57.827247 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bd1fd-8936-4e75-bdaf-0c7254650e43 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:57.827894 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bd1fd-8936-4e75-bdaf-0c7254650e43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:57.828198 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bd1fd-8936-4e75-bdaf-0c7254650e43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:57.829970 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bd1fd-8936-4e75-bdaf-0c7254650e43 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:57.841709 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 260/516] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:57.842606 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bd1fd-8936-4e75-bdaf-0c7254650e43 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:57.847057 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:57.895009 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229609ea-53ee-4459-80a9-45bd12bf82b4 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:57.914620 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:57.928567 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598df92-bc58-478c-a34e-692cc39559e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:57.929202 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598df92-bc58-478c-a34e-692cc39559e6 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:57.929482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598df92-bc58-478c-a34e-692cc39559e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:57.929748 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598df92-bc58-478c-a34e-692cc39559e6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:57.937353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598df92-bc58-478c-a34e-692cc39559e6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:57.938795 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598df92-bc58-478c-a34e-692cc39559e6 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:57.941319 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bd1fd-8936-4e75-bdaf-0c7254650e43 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-a598df92-bc58-478c-a34e-692cc39559e6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:41:57.950304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:57.951788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:57.952708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:57.952708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:57.952708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:41:57.952708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:41:57.952708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:41:57.952708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:41:57.952708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:41:57.952708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:41:57.952708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 00:41:57.952708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:57.952708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 257/517] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:41:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:57.952708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598df92-bc58-478c-a34e-692cc39559e6 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:57.979452 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0e65f-67b4-4ee1-a029-f435354af512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:57.980081 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0e65f-67b4-4ee1-a029-f435354af512 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:57.980352 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0e65f-67b4-4ee1-a029-f435354af512 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:57.980658 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0e65f-67b4-4ee1-a029-f435354af512 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:57.990014 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0e65f-67b4-4ee1-a029-f435354af512 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:57.992016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0e65f-67b4-4ee1-a029-f435354af512 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-86a0e65f-67b4-4ee1-a029-f435354af512 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:41:58.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:58.005263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:58.006101 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:41:58.006101 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:41:58.006101 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:41:58.006101 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:41:58.006101 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:41:58.006101 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:41:58.006101 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:41:58.006101 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:58.006101 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 261/518] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:58.006568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0e65f-67b4-4ee1-a029-f435354af512 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:58.056161 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598df92-bc58-478c-a34e-692cc39559e6 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:58.068746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:58.089910 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf916c-98c1-403a-9ccb-b011df815008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:58.090450 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf916c-98c1-403a-9ccb-b011df815008 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:58.090729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf916c-98c1-403a-9ccb-b011df815008 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:58.091006 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf916c-98c1-403a-9ccb-b011df815008 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:58.091856 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf916c-98c1-403a-9ccb-b011df815008 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:58.092240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf916c-98c1-403a-9ccb-b011df815008 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:58.093733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf916c-98c1-403a-9ccb-b011df815008 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:58.107463 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0e65f-67b4-4ee1-a029-f435354af512 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:58.110227 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 258/519] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Sep 25 00:41:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:58.111014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf916c-98c1-403a-9ccb-b011df815008 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:58.140501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55b4cb-7a76-497f-bce2-f6dc78b1eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:58.141137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55b4cb-7a76-497f-bce2-f6dc78b1eada None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:58.141412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55b4cb-7a76-497f-bce2-f6dc78b1eada None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:58.141686 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55b4cb-7a76-497f-bce2-f6dc78b1eada None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:58.151148 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:58.207867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55b4cb-7a76-497f-bce2-f6dc78b1eada None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:58.209355 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55b4cb-7a76-497f-bce2-f6dc78b1eada None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:58.209625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf916c-98c1-403a-9ccb-b011df815008 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:58.242473 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08577b51-e2f4-4e1e-874d-88e2e99d692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:58.243127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577b51-e2f4-4e1e-874d-88e2e99d692d None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:58.243410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577b51-e2f4-4e1e-874d-88e2e99d692d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:58.243686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577b51-e2f4-4e1e-874d-88e2e99d692d None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:58.244348 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08577b51-e2f4-4e1e-874d-88e2e99d692d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:58.245804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08577b51-e2f4-4e1e-874d-88e2e99d692d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:58.265944 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 259/520] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:41:58 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:41:58.266736 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08577b51-e2f4-4e1e-874d-88e2e99d692d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:58.268312 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:58.313868 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 262/521] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:58.314752 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55b4cb-7a76-497f-bce2-f6dc78b1eada None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:58.380379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:58.388389 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08577b51-e2f4-4e1e-874d-88e2e99d692d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:58.428397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4174c79-4339-4c5c-9c0f-9700994e54cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:58.429136 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4174c79-4339-4c5c-9c0f-9700994e54cd None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:58.429394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4174c79-4339-4c5c-9c0f-9700994e54cd None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:58.429567 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4174c79-4339-4c5c-9c0f-9700994e54cd None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:58.430300 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4174c79-4339-4c5c-9c0f-9700994e54cd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:58.430604 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4174c79-4339-4c5c-9c0f-9700994e54cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:58.432023 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4174c79-4339-4c5c-9c0f-9700994e54cd None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:58.432213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55b4cb-7a76-497f-bce2-f6dc78b1eada None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:58.454032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 260/522] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Sep 25 00:41:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:58.454871 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4174c79-4339-4c5c-9c0f-9700994e54cd None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:58.472030 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abfaed-8db6-4862-bcda-d153a594a73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:58.472267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abfaed-8db6-4862-bcda-d153a594a73f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:58.472541 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abfaed-8db6-4862-bcda-d153a594a73f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:58.472841 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abfaed-8db6-4862-bcda-d153a594a73f None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:58.477548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abfaed-8db6-4862-bcda-d153a594a73f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:58.477548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abfaed-8db6-4862-bcda-d153a594a73f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:58.477548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abfaed-8db6-4862-bcda-d153a594a73f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:58.494331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 263/523] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:41:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:58.495027 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abfaed-8db6-4862-bcda-d153a594a73f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:58.521874 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:58.570082 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4174c79-4339-4c5c-9c0f-9700994e54cd None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:58.598539 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abfaed-8db6-4862-bcda-d153a594a73f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:58.606212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d071f-00de-43fc-9e88-d6c45d555156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:58.607428 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d071f-00de-43fc-9e88-d6c45d555156 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:58.607704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d071f-00de-43fc-9e88-d6c45d555156 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:58.607971 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d071f-00de-43fc-9e88-d6c45d555156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:58.629008 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:58.634531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b71120-bac4-4a0c-8ff0-8909e83bee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:58.635097 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b71120-bac4-4a0c-8ff0-8909e83bee0f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:58.635389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b71120-bac4-4a0c-8ff0-8909e83bee0f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:58.635640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b71120-bac4-4a0c-8ff0-8909e83bee0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:58.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b71120-bac4-4a0c-8ff0-8909e83bee0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:58.647565 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b71120-bac4-4a0c-8ff0-8909e83bee0f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-e9b71120-bac4-4a0c-8ff0-8909e83bee0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:41:58.663807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:58.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:41:58.666316 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:41:58.666316 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:58.666316 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:58.666316 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 264/524] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:58.670602 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b71120-bac4-4a0c-8ff0-8909e83bee0f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:58.681749 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d071f-00de-43fc-9e88-d6c45d555156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:58.683287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d071f-00de-43fc-9e88-d6c45d555156 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:58.754035 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:58.780082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b71120-bac4-4a0c-8ff0-8909e83bee0f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:58.792645 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 261/525] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:58.792645 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d071f-00de-43fc-9e88-d6c45d555156 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:58.824439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb958267-c3cc-40b5-8a8f-4970721bede3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:58.825327 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb958267-c3cc-40b5-8a8f-4970721bede3 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:58.825689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb958267-c3cc-40b5-8a8f-4970721bede3 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:58.825995 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb958267-c3cc-40b5-8a8f-4970721bede3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:58.851791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:58.900871 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d071f-00de-43fc-9e88-d6c45d555156 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:58.902422 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb958267-c3cc-40b5-8a8f-4970721bede3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:58.904619 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb958267-c3cc-40b5-8a8f-4970721bede3 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:58.937125 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a968c17-9c42-4ee2-bc3c-cbf7dde69f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:58.937810 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a968c17-9c42-4ee2-bc3c-cbf7dde69f81 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:58.938158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a968c17-9c42-4ee2-bc3c-cbf7dde69f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:58.938503 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a968c17-9c42-4ee2-bc3c-cbf7dde69f81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:58.939286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a968c17-9c42-4ee2-bc3c-cbf7dde69f81 None admin] RBAC: Adding query filter params (role.id=e190761ca5494052a96426d0bd344261, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=d494b82a81ca42a69fe7d9efc2f2a251) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:58.939666 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a968c17-9c42-4ee2-bc3c-cbf7dde69f81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:58.941182 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a968c17-9c42-4ee2-bc3c-cbf7dde69f81 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:58.956591 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 262/526] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:58 2022] GET /identity/v3/role_assignments?user.id=d494b82a81ca42a69fe7d9efc2f2a251&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=e190761ca5494052a96426d0bd344261 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:58.956591 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a968c17-9c42-4ee2-bc3c-cbf7dde69f81 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:58.995242 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:59.029313 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 265/527] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:41:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:41:59.030608 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb958267-c3cc-40b5-8a8f-4970721bede3 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:59.080415 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a968c17-9c42-4ee2-bc3c-cbf7dde69f81 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:59.099070 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:59.120320 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d599dcc-222e-4922-b456-03c9cff2a67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:59.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d599dcc-222e-4922-b456-03c9cff2a67b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:59.121279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d599dcc-222e-4922-b456-03c9cff2a67b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:59.121560 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d599dcc-222e-4922-b456-03c9cff2a67b None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:59.122243 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d599dcc-222e-4922-b456-03c9cff2a67b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:59.122618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d599dcc-222e-4922-b456-03c9cff2a67b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:59.124031 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d599dcc-222e-4922-b456-03c9cff2a67b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:59.142090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 263/528] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:59.142090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d599dcc-222e-4922-b456-03c9cff2a67b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:59.156613 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb958267-c3cc-40b5-8a8f-4970721bede3 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:59.195612 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acf8ee-a0c7-408b-a30b-5f299336cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:59.196659 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acf8ee-a0c7-408b-a30b-5f299336cafd None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:59.197408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acf8ee-a0c7-408b-a30b-5f299336cafd None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:59.197892 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acf8ee-a0c7-408b-a30b-5f299336cafd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:59.210938 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acf8ee-a0c7-408b-a30b-5f299336cafd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:59.212881 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acf8ee-a0c7-408b-a30b-5f299336cafd None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-81acf8ee-a0c7-408b-a30b-5f299336cafd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:41:59.229740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:59.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:41:59.231548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:41:59.231548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:59.231548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:59.234256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 266/529] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:59.235325 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acf8ee-a0c7-408b-a30b-5f299336cafd None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:59.267240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d599dcc-222e-4922-b456-03c9cff2a67b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:59.277166 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:59.309848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be1530-7a05-4261-96e6-fa559a2080b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:59.310802 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be1530-7a05-4261-96e6-fa559a2080b2 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:59.311258 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be1530-7a05-4261-96e6-fa559a2080b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:59.311705 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be1530-7a05-4261-96e6-fa559a2080b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:59.324813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be1530-7a05-4261-96e6-fa559a2080b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:59.326802 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be1530-7a05-4261-96e6-fa559a2080b2 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-c4be1530-7a05-4261-96e6-fa559a2080b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:41:59.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:59.347481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:41:59.348529 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:41:59.348529 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:41:59.348529 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:59.354356 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 264/530] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:59.354356 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be1530-7a05-4261-96e6-fa559a2080b2 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:59.378242 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acf8ee-a0c7-408b-a30b-5f299336cafd None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:59.386330 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:59.414022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e0a8a-5da3-4188-9e5d-afa73128fef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:59.414717 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e0a8a-5da3-4188-9e5d-afa73128fef9 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:59.415103 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e0a8a-5da3-4188-9e5d-afa73128fef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:59.415476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e0a8a-5da3-4188-9e5d-afa73128fef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:59.423375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e0a8a-5da3-4188-9e5d-afa73128fef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:59.425064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e0a8a-5da3-4188-9e5d-afa73128fef9 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-497e0a8a-5da3-4188-9e5d-afa73128fef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:41:59.439401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:59.440930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:59.441798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:41:59.441798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:41:59.441798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:41:59.441798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:41:59.441798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:41:59.441798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:41:59.441798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:41:59.441798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:59.441798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 267/531] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:59.444652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e0a8a-5da3-4188-9e5d-afa73128fef9 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:59.475390 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be1530-7a05-4261-96e6-fa559a2080b2 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:59.517865 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980085ea-951a-4f33-9864-386b80a9ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:59.518924 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980085ea-951a-4f33-9864-386b80a9ed8a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:59.519583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980085ea-951a-4f33-9864-386b80a9ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:59.519880 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980085ea-951a-4f33-9864-386b80a9ed8a None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:59.520532 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980085ea-951a-4f33-9864-386b80a9ed8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:59.520887 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980085ea-951a-4f33-9864-386b80a9ed8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:59.522267 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980085ea-951a-4f33-9864-386b80a9ed8a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:59.550328 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 265/532] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:59.551248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980085ea-951a-4f33-9864-386b80a9ed8a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:59.576503 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e0a8a-5da3-4188-9e5d-afa73128fef9 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:59.580749 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:59.626663 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f7120-6e13-4216-82e2-accf231c4754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:59.627812 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f7120-6e13-4216-82e2-accf231c4754 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:59.629816 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f7120-6e13-4216-82e2-accf231c4754 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:59.630138 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f7120-6e13-4216-82e2-accf231c4754 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:59.631009 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f7120-6e13-4216-82e2-accf231c4754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:59.632495 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f7120-6e13-4216-82e2-accf231c4754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:59.633917 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f7120-6e13-4216-82e2-accf231c4754 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:59.653388 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 268/533] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:59.655048 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f7120-6e13-4216-82e2-accf231c4754 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:59.660606 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:59.675735 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980085ea-951a-4f33-9864-386b80a9ed8a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:59.712531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b65ac4-ebb7-4664-b392-f9be42260feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:59.713250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b65ac4-ebb7-4664-b392-f9be42260feb None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:59.713505 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b65ac4-ebb7-4664-b392-f9be42260feb None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:59.713779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b65ac4-ebb7-4664-b392-f9be42260feb None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:59.714485 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b65ac4-ebb7-4664-b392-f9be42260feb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:41:59.714764 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b65ac4-ebb7-4664-b392-f9be42260feb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:59.716781 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b65ac4-ebb7-4664-b392-f9be42260feb None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:59.739886 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 266/534] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:41:59.739886 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b65ac4-ebb7-4664-b392-f9be42260feb None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:59.789725 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f7120-6e13-4216-82e2-accf231c4754 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:59.842607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156cd23-2ae5-492c-be91-777ce3e103c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:59.843992 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156cd23-2ae5-492c-be91-777ce3e103c9 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:59.844588 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156cd23-2ae5-492c-be91-777ce3e103c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:59.845137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156cd23-2ae5-492c-be91-777ce3e103c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:59.854736 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156cd23-2ae5-492c-be91-777ce3e103c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:59.857258 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156cd23-2ae5-492c-be91-777ce3e103c9 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:59.862437 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b65ac4-ebb7-4664-b392-f9be42260feb None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-0156cd23-2ae5-492c-be91-777ce3e103c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:41:59.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:59.873125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:59.873950 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:41:59.873950 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:41:59.873950 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:41:59.873950 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:41:59.873950 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:41:59.873950 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:41:59.873950 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:41:59.873950 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:41:59.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 269/535] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:59.878044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156cd23-2ae5-492c-be91-777ce3e103c9 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:59.892485 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:41:59.916675 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5512739-2557-4b37-8389-e31bb3939dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:41:59.917849 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5512739-2557-4b37-8389-e31bb3939dbd None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:41:59.918684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5512739-2557-4b37-8389-e31bb3939dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:41:59.919299 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5512739-2557-4b37-8389-e31bb3939dbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:41:59.928577 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5512739-2557-4b37-8389-e31bb3939dbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:41:59.930690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5512739-2557-4b37-8389-e31bb3939dbd None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-e5512739-2557-4b37-8389-e31bb3939dbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:41:59.947659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:41:59.948701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:41:59.949719 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:41:59.949719 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:41:59.949719 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:41:59.949719 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:41:59.949719 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:41:59.949719 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:41:59.949719 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:41:59.949719 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:41:59.952856 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 267/536] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:41:59.953844 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5512739-2557-4b37-8389-e31bb3939dbd None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:41:59.968647 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:00.002679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156cd23-2ae5-492c-be91-777ce3e103c9 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:00.039241 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796668c2-2da6-4b9b-86f0-c7264b91bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:00.039832 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796668c2-2da6-4b9b-86f0-c7264b91bc45 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:00.040253 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796668c2-2da6-4b9b-86f0-c7264b91bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:00.040612 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796668c2-2da6-4b9b-86f0-c7264b91bc45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:00.041409 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796668c2-2da6-4b9b-86f0-c7264b91bc45 None admin] RBAC: Adding query filter params (role.id=e190761ca5494052a96426d0bd344261, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=41cd0c4bf9734339ba9e8f2dabb9a0ad) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:00.041815 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796668c2-2da6-4b9b-86f0-c7264b91bc45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:00.043437 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796668c2-2da6-4b9b-86f0-c7264b91bc45 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:00.056592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 270/537] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:41:59 2022] GET /identity/v3/role_assignments?user.id=41cd0c4bf9734339ba9e8f2dabb9a0ad&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=e190761ca5494052a96426d0bd344261 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:00.056592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796668c2-2da6-4b9b-86f0-c7264b91bc45 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:00.114490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5512739-2557-4b37-8389-e31bb3939dbd None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:00.184382 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7312-888b-4972-a3d6-baa40a781c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:00.185550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7312-888b-4972-a3d6-baa40a781c7d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:00.185828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7312-888b-4972-a3d6-baa40a781c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:00.186101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7312-888b-4972-a3d6-baa40a781c7d None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:00.186799 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf7312-888b-4972-a3d6-baa40a781c7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:00.187102 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf7312-888b-4972-a3d6-baa40a781c7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:00.188572 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf7312-888b-4972-a3d6-baa40a781c7d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:00.203434 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:00.217610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 268/538] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:00.223611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7312-888b-4972-a3d6-baa40a781c7d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:00.257949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796668c2-2da6-4b9b-86f0-c7264b91bc45 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:00.327967 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50033d0c-5829-4396-91c4-ae369aa9aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:00.330317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50033d0c-5829-4396-91c4-ae369aa9aad1 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:00.330802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50033d0c-5829-4396-91c4-ae369aa9aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:00.332177 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50033d0c-5829-4396-91c4-ae369aa9aad1 None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:00.333114 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50033d0c-5829-4396-91c4-ae369aa9aad1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:00.336800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50033d0c-5829-4396-91c4-ae369aa9aad1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:00.338475 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50033d0c-5829-4396-91c4-ae369aa9aad1 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:00.343492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:00.354692 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 271/539] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:00.361868 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50033d0c-5829-4396-91c4-ae369aa9aad1 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:00.423711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7312-888b-4972-a3d6-baa40a781c7d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:00.492054 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eec3a-2f5f-437b-ae85-467142f3dd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:00.492703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eec3a-2f5f-437b-ae85-467142f3dd61 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:00.493040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eec3a-2f5f-437b-ae85-467142f3dd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:00.493317 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eec3a-2f5f-437b-ae85-467142f3dd61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:00.494052 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eec3a-2f5f-437b-ae85-467142f3dd61 None admin] RBAC: Adding query filter params (role.id=e190761ca5494052a96426d0bd344261, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=94b2d0afc3294d75897dda3dd8f78aed) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:00.494371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eec3a-2f5f-437b-ae85-467142f3dd61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:00.495908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eec3a-2f5f-437b-ae85-467142f3dd61 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:00.504411 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 269/540] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:00 2022] GET /identity/v3/role_assignments?user.id=94b2d0afc3294d75897dda3dd8f78aed&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=e190761ca5494052a96426d0bd344261 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:00.505730 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb77b6-ce45-4a40-9b26-0e56eb82c04e None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:00.506016 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb77b6-ce45-4a40-9b26-0e56eb82c04e None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:00.506294 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb77b6-ce45-4a40-9b26-0e56eb82c04e None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:00.507893 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 270/541] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:00.522232 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a432858-f6fe-4015-828b-843938b05bb2 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:00.522566 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a432858-f6fe-4015-828b-843938b05bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:00.522784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a432858-f6fe-4015-828b-843938b05bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:00.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-7a432858-f6fe-4015-828b-843938b05bb2 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:00.547278 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-7a432858-f6fe-4015-828b-843938b05bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:00.568206 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50033d0c-5829-4396-91c4-ae369aa9aad1 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:00.611051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:00.619471 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a091f0-3f77-4ba7-9343-078ae9a2954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:00.621115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a091f0-3f77-4ba7-9343-078ae9a2954a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:00.621732 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a091f0-3f77-4ba7-9343-078ae9a2954a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:00.622215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a091f0-3f77-4ba7-9343-078ae9a2954a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:00.623475 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a091f0-3f77-4ba7-9343-078ae9a2954a None admin] RBAC: Adding query filter params (role.id=e190761ca5494052a96426d0bd344261, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=42a2f85512e648698fdc7ab7cac75752) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:00.624393 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a091f0-3f77-4ba7-9343-078ae9a2954a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:00.626631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a091f0-3f77-4ba7-9343-078ae9a2954a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:00.628843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 271/542] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 25 00:42:00.635759 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 272/543] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:00 2022] GET /identity/v3/role_assignments?user.id=42a2f85512e648698fdc7ab7cac75752&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=e190761ca5494052a96426d0bd344261 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:00.938405 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a432858-f6fe-4015-828b-843938b05bb2 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:01.018181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:01.065891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a432858-f6fe-4015-828b-843938b05bb2 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:01.103515 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535ffcc-6e91-4577-abe3-9820b51d6877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:01.104800 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535ffcc-6e91-4577-abe3-9820b51d6877 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:01.105532 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535ffcc-6e91-4577-abe3-9820b51d6877 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:01.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535ffcc-6e91-4577-abe3-9820b51d6877 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:01.117341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535ffcc-6e91-4577-abe3-9820b51d6877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-b535ffcc-6e91-4577-abe3-9820b51d6877 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:01.122964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:01.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:01.124650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:01.124650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:01.124650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:01.124650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:01.124650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:01.124650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:01.124650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:01.124650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:01.124650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:01.124650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:01.124650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:01.124650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:01.126969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 272/544] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:01.138583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a091f0-3f77-4ba7-9343-078ae9a2954a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:01.293432 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a091f0-3f77-4ba7-9343-078ae9a2954a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:01.339565 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e96b3f-3866-4585-99be-b25898c48600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:01.340180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96b3f-3866-4585-99be-b25898c48600 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:01.340455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96b3f-3866-4585-99be-b25898c48600 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:01.340761 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96b3f-3866-4585-99be-b25898c48600 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:01.341439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e96b3f-3866-4585-99be-b25898c48600 None admin] RBAC: Adding query filter params (name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:01.341735 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e96b3f-3866-4585-99be-b25898c48600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:01.343117 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e96b3f-3866-4585-99be-b25898c48600 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:01.352569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 273/545] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:42:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:01.355878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b028aec-68b7-4896-ab25-fc9556993973 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:01.356211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b028aec-68b7-4896-ab25-fc9556993973 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:01.357056 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b028aec-68b7-4896-ab25-fc9556993973 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:01.358755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e96b3f-3866-4585-99be-b25898c48600 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:01.361921 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 273/546] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:42:01.368422 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5a78e-62c7-4538-8bfd-e271f0c1a602 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:01.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5a78e-62c7-4538-8bfd-e271f0c1a602 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:01.369024 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5a78e-62c7-4538-8bfd-e271f0c1a602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:01.410223 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-0ac5a78e-62c7-4538-8bfd-e271f0c1a602 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:01.411551 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-0ac5a78e-62c7-4538-8bfd-e271f0c1a602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:01.468568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:01.553496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e96b3f-3866-4585-99be-b25898c48600 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:01.568281 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 274/547] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:01.598046 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921a87a-ea58-4f3b-8b4d-e2bf5a85e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:01.598701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921a87a-ea58-4f3b-8b4d-e2bf5a85e525 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:01.599010 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921a87a-ea58-4f3b-8b4d-e2bf5a85e525 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:01.599340 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921a87a-ea58-4f3b-8b4d-e2bf5a85e525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:01.611449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921a87a-ea58-4f3b-8b4d-e2bf5a85e525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:01.612892 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921a87a-ea58-4f3b-8b4d-e2bf5a85e525 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-1921a87a-ea58-4f3b-8b4d-e2bf5a85e525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:01.628091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:01.629039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:01.629849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:01.629849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:01.629849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:01.629849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 274/548] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:01.637674 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5a78e-62c7-4538-8bfd-e271f0c1a602 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:01.715728 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:01.764802 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5a78e-62c7-4538-8bfd-e271f0c1a602 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:01.799647 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b2742-16f5-41f5-9b63-84a2d146916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:01.800258 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b2742-16f5-41f5-9b63-84a2d146916f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:01.800532 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b2742-16f5-41f5-9b63-84a2d146916f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:01.800827 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b2742-16f5-41f5-9b63-84a2d146916f None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:01.801470 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b2742-16f5-41f5-9b63-84a2d146916f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:01.801770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b2742-16f5-41f5-9b63-84a2d146916f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:01.803129 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b2742-16f5-41f5-9b63-84a2d146916f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:01.815367 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 275/549] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:01.820721 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921a87a-ea58-4f3b-8b4d-e2bf5a85e525 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:01.874796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b2742-16f5-41f5-9b63-84a2d146916f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:01.964091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921a87a-ea58-4f3b-8b4d-e2bf5a85e525 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:01.978731 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:02.008710 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7374b-4917-4afc-9641-3d314ba6d749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:02.010516 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7374b-4917-4afc-9641-3d314ba6d749 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:02.010983 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7374b-4917-4afc-9641-3d314ba6d749 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:02.011465 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7374b-4917-4afc-9641-3d314ba6d749 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:02.020740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7374b-4917-4afc-9641-3d314ba6d749 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:02.022443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7374b-4917-4afc-9641-3d314ba6d749 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-7cb7374b-4917-4afc-9641-3d314ba6d749 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:02.037444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:02.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:02.039932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:02.039932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:02.039932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:02.039932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:02.039932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:02.039932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:02.039932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:02.039932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:02.039932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:42:02.039932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:02.042467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 275/550] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:42:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:02.047580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7374b-4917-4afc-9641-3d314ba6d749 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:02.077366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b2742-16f5-41f5-9b63-84a2d146916f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:02.102712 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:02.158243 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539029c-ca39-4e87-a268-2f7be204b3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:02.158895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539029c-ca39-4e87-a268-2f7be204b3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:02.159175 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539029c-ca39-4e87-a268-2f7be204b3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:02.159448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539029c-ca39-4e87-a268-2f7be204b3f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:02.170615 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7374b-4917-4afc-9641-3d314ba6d749 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:02.183644 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539029c-ca39-4e87-a268-2f7be204b3f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-d539029c-ca39-4e87-a268-2f7be204b3f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:02.190984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:02.191877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:02.192894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:02.192894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:02.192894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:02.192894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:02.192894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:02.192894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:02.192894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:02.192894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:02.192894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:02.192894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:02.192894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:02.192894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:02.196457 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 276/551] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:02.203179 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539029c-ca39-4e87-a268-2f7be204b3f0 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:02.243407 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0b6bb-8c1c-4a85-b534-a3da38034a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:02.244023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0b6bb-8c1c-4a85-b534-a3da38034a3d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:02.244307 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0b6bb-8c1c-4a85-b534-a3da38034a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:02.244733 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0b6bb-8c1c-4a85-b534-a3da38034a3d None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:02.245435 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0b6bb-8c1c-4a85-b534-a3da38034a3d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:02.245751 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0b6bb-8c1c-4a85-b534-a3da38034a3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:02.247348 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0b6bb-8c1c-4a85-b534-a3da38034a3d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:02.282630 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 276/552] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Sep 25 00:42:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:02.288377 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0b6bb-8c1c-4a85-b534-a3da38034a3d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:02.335268 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539029c-ca39-4e87-a268-2f7be204b3f0 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:02.350151 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:02.383109 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495c78c-5c15-4648-be4d-db519ef00573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:02.384102 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495c78c-5c15-4648-be4d-db519ef00573 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:02.384612 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495c78c-5c15-4648-be4d-db519ef00573 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:02.385252 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495c78c-5c15-4648-be4d-db519ef00573 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:02.387198 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495c78c-5c15-4648-be4d-db519ef00573 None admin] RBAC: Adding query filter params (name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:02.388718 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495c78c-5c15-4648-be4d-db519ef00573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:02.390308 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495c78c-5c15-4648-be4d-db519ef00573 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:02.408506 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 277/553] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:42:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:02.414453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495c78c-5c15-4648-be4d-db519ef00573 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:02.481100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:02.484290 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0b6bb-8c1c-4a85-b534-a3da38034a3d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:02.563565 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94b909-2100-4f2b-804a-3361fba7eafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:02.564235 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94b909-2100-4f2b-804a-3361fba7eafe None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:02.564520 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94b909-2100-4f2b-804a-3361fba7eafe None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:02.564878 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94b909-2100-4f2b-804a-3361fba7eafe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:02.615262 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495c78c-5c15-4648-be4d-db519ef00573 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:02.673857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94b909-2100-4f2b-804a-3361fba7eafe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:02.675314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94b909-2100-4f2b-804a-3361fba7eafe None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:02.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d7318-d362-42de-8ae8-fd456723d28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:02.677946 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d7318-d362-42de-8ae8-fd456723d28a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:02.678884 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d7318-d362-42de-8ae8-fd456723d28a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:02.678884 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d7318-d362-42de-8ae8-fd456723d28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:02.690627 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d7318-d362-42de-8ae8-fd456723d28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:02.692197 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d7318-d362-42de-8ae8-fd456723d28a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:02.710340 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-f28d7318-d362-42de-8ae8-fd456723d28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:02.719394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:02.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:02.721883 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:02.721883 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:02.721883 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:02.721883 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 278/554] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:02.731104 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d7318-d362-42de-8ae8-fd456723d28a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:02.846903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 277/555] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:42:02.848317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bc4a9-c14f-4593-8833-eef9543a0117 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:02.848621 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bc4a9-c14f-4593-8833-eef9543a0117 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:02.848900 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bc4a9-c14f-4593-8833-eef9543a0117 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:02.850447 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 278/556] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:02.858114 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea2aae-5bc4-4866-a910-a478db5a057f None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:02.858568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea2aae-5bc4-4866-a910-a478db5a057f None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:02.858994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea2aae-5bc4-4866-a910-a478db5a057f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:02.874297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:02.880000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-0dea2aae-5bc4-4866-a910-a478db5a057f None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:02.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-0dea2aae-5bc4-4866-a910-a478db5a057f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:02.890943 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d7318-d362-42de-8ae8-fd456723d28a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:02.931270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2495be8-beaa-45ff-b376-0b015f7ed63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:02.931802 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2495be8-beaa-45ff-b376-0b015f7ed63d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:02.932086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2495be8-beaa-45ff-b376-0b015f7ed63d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:02.932366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2495be8-beaa-45ff-b376-0b015f7ed63d None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:02.933044 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2495be8-beaa-45ff-b376-0b015f7ed63d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:02.933406 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2495be8-beaa-45ff-b376-0b015f7ed63d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:02.935522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2495be8-beaa-45ff-b376-0b015f7ed63d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:02.954908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 279/557] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:02.956591 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2495be8-beaa-45ff-b376-0b015f7ed63d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:02.986451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 279/558] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:02.986451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea2aae-5bc4-4866-a910-a478db5a057f None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:03.095191 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:03.115306 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2495be8-beaa-45ff-b376-0b015f7ed63d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:03.151376 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d2f0c-b4d4-480e-8048-506e8616078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:03.152384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d2f0c-b4d4-480e-8048-506e8616078f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:03.152896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d2f0c-b4d4-480e-8048-506e8616078f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:03.153910 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d2f0c-b4d4-480e-8048-506e8616078f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:03.164757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d2f0c-b4d4-480e-8048-506e8616078f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:03.166511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d2f0c-b4d4-480e-8048-506e8616078f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:03.174575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:03.176743 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea2aae-5bc4-4866-a910-a478db5a057f None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-9a2d2f0c-b4d4-480e-8048-506e8616078f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:03.184089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:03.185188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:03.186069 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:03.186069 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:03.186069 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:03.194666 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 280/559] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:03.196310 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651405-84b7-4330-bf15-4f1658599eb7 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:03.196836 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651405-84b7-4330-bf15-4f1658599eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:03.197593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651405-84b7-4330-bf15-4f1658599eb7 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:03.199394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 281/560] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:03.200755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651405-84b7-4330-bf15-4f1658599eb7 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:03.225124 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16d8e5-4546-4e3c-b219-c2f559d75831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:03.225767 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16d8e5-4546-4e3c-b219-c2f559d75831 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:03.226043 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16d8e5-4546-4e3c-b219-c2f559d75831 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:03.226345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16d8e5-4546-4e3c-b219-c2f559d75831 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:03.237449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16d8e5-4546-4e3c-b219-c2f559d75831 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:03.239146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16d8e5-4546-4e3c-b219-c2f559d75831 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-9a16d8e5-4546-4e3c-b219-c2f559d75831 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:03.254106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:03.255095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:03.256016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:03.256016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:03.256016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:03.256016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:03.256016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:03.256016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:03.256016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:03.256016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:03.256016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:42:03.256016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:03.256016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 280/561] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Sep 25 00:42:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:03.257842 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585591ac-3963-4d0c-a1ed-61a02e48bb4f None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:03.258124 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585591ac-3963-4d0c-a1ed-61a02e48bb4f None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:03.258400 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585591ac-3963-4d0c-a1ed-61a02e48bb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:03.282138 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-585591ac-3963-4d0c-a1ed-61a02e48bb4f None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:03.283358 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-585591ac-3963-4d0c-a1ed-61a02e48bb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:03.329924 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651405-84b7-4330-bf15-4f1658599eb7 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:03.364577 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 281/562] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:03.364577 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585591ac-3963-4d0c-a1ed-61a02e48bb4f None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:03.376713 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1537b-d41e-4a24-8f2b-f5d034775555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:03.377745 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1537b-d41e-4a24-8f2b-f5d034775555 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:03.378030 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1537b-d41e-4a24-8f2b-f5d034775555 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:03.378309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1537b-d41e-4a24-8f2b-f5d034775555 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:03.378962 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1537b-d41e-4a24-8f2b-f5d034775555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:03.379270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1537b-d41e-4a24-8f2b-f5d034775555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:03.381218 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1537b-d41e-4a24-8f2b-f5d034775555 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:03.400741 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 282/563] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:03.401629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1537b-d41e-4a24-8f2b-f5d034775555 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:03.413946 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:03.476582 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:03.479528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585591ac-3963-4d0c-a1ed-61a02e48bb4f None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:03.524298 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa71a3-debc-4da2-99a3-659ee6ddf452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:03.525132 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa71a3-debc-4da2-99a3-659ee6ddf452 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:03.525580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa71a3-debc-4da2-99a3-659ee6ddf452 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:03.525930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa71a3-debc-4da2-99a3-659ee6ddf452 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:03.526836 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa71a3-debc-4da2-99a3-659ee6ddf452 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:03.527282 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa71a3-debc-4da2-99a3-659ee6ddf452 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:03.529434 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa71a3-debc-4da2-99a3-659ee6ddf452 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:03.529641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1537b-d41e-4a24-8f2b-f5d034775555 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:03.547773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 282/564] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Sep 25 00:42:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:03.548796 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa71a3-debc-4da2-99a3-659ee6ddf452 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:03.568273 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08ea09-6f96-40c6-a8d4-99ea6555d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:03.568938 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08ea09-6f96-40c6-a8d4-99ea6555d526 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:03.569218 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08ea09-6f96-40c6-a8d4-99ea6555d526 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:03.569496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08ea09-6f96-40c6-a8d4-99ea6555d526 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:03.581014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08ea09-6f96-40c6-a8d4-99ea6555d526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-1c08ea09-6f96-40c6-a8d4-99ea6555d526 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:03.585763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:03.586684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:03.587536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:03.587536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:03.587536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:03.587536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:03.587536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:03.587536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:03.587536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:03.587536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:03.587536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:03.587536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:03.587536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:03.587536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:03.587536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 283/565] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:03.588607 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c5b0a-7523-4536-92a5-38024126b659 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:03.588607 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c5b0a-7523-4536-92a5-38024126b659 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:03.588607 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c5b0a-7523-4536-92a5-38024126b659 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:03.589920 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 284/566] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:03.593294 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c5b0a-7523-4536-92a5-38024126b659 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:03.668378 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa71a3-debc-4da2-99a3-659ee6ddf452 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:03.675529 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:03.698824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c5b0a-7523-4536-92a5-38024126b659 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:03.702808 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d62d1d-cebc-43c0-91d1-53ff2c67740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:03.703442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d62d1d-cebc-43c0-91d1-53ff2c67740e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:03.703723 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d62d1d-cebc-43c0-91d1-53ff2c67740e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:03.704000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d62d1d-cebc-43c0-91d1-53ff2c67740e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:03.710617 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d62d1d-cebc-43c0-91d1-53ff2c67740e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:03.712053 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d62d1d-cebc-43c0-91d1-53ff2c67740e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:03.717113 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-27d62d1d-cebc-43c0-91d1-53ff2c67740e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:03.723571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:03.724440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:03.725335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:03.725335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:03.725335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:03.725335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:03.725335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:03.725335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:03.725335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:03.725335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:03.725335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 283/567] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:03.725805 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d62d1d-cebc-43c0-91d1-53ff2c67740e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:03.738971 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675134cc-5654-4da9-a0b7-79bef2ce1338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:03.739540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675134cc-5654-4da9-a0b7-79bef2ce1338 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:03.739818 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675134cc-5654-4da9-a0b7-79bef2ce1338 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:03.740093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675134cc-5654-4da9-a0b7-79bef2ce1338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:03.750259 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675134cc-5654-4da9-a0b7-79bef2ce1338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:03.751732 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675134cc-5654-4da9-a0b7-79bef2ce1338 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-675134cc-5654-4da9-a0b7-79bef2ce1338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:03.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:03.767511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:03.768708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:03.768708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:03.768708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:03.768708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 285/568] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:03.768708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a9d0-e379-4453-8d14-e585b2e4fdee None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:03.769052 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a9d0-e379-4453-8d14-e585b2e4fdee None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:03.769225 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a9d0-e379-4453-8d14-e585b2e4fdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:03.787290 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-baa9a9d0-e379-4453-8d14-e585b2e4fdee None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:03.788488 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-baa9a9d0-e379-4453-8d14-e585b2e4fdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:03.827734 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d62d1d-cebc-43c0-91d1-53ff2c67740e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:03.858649 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 286/569] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:03.859498 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9a9d0-e379-4453-8d14-e585b2e4fdee None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:03.866508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ffad4-b3b7-4e17-942f-e222e5527f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:03.867116 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ffad4-b3b7-4e17-942f-e222e5527f8c None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:03.867392 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ffad4-b3b7-4e17-942f-e222e5527f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:03.867660 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ffad4-b3b7-4e17-942f-e222e5527f8c None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:03.868322 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ffad4-b3b7-4e17-942f-e222e5527f8c None admin] RBAC: Adding query filter params (name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:03.868658 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ffad4-b3b7-4e17-942f-e222e5527f8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:03.870018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ffad4-b3b7-4e17-942f-e222e5527f8c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:03.883023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 284/570] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:42:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:03.883903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ffad4-b3b7-4e17-942f-e222e5527f8c None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:03.913043 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:03.974736 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:03.978511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9a9d0-e379-4453-8d14-e585b2e4fdee None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:03.985567 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ffad4-b3b7-4e17-942f-e222e5527f8c None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:04.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8daabf-fb9d-4739-a02e-bdae33bb3d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:04.021976 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea8ed5-cc8b-42cb-9ac1-2bec53e97c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:04.022364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea8ed5-cc8b-42cb-9ac1-2bec53e97c56 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:04.022640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea8ed5-cc8b-42cb-9ac1-2bec53e97c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:04.022749 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8daabf-fb9d-4739-a02e-bdae33bb3d36 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:04.022913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea8ed5-cc8b-42cb-9ac1-2bec53e97c56 None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:04.023200 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8daabf-fb9d-4739-a02e-bdae33bb3d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:04.023582 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8daabf-fb9d-4739-a02e-bdae33bb3d36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:04.023670 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea8ed5-cc8b-42cb-9ac1-2bec53e97c56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:04.023891 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea8ed5-cc8b-42cb-9ac1-2bec53e97c56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:04.025356 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea8ed5-cc8b-42cb-9ac1-2bec53e97c56 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:04.034705 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8daabf-fb9d-4739-a02e-bdae33bb3d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:04.037572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 285/571] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:04.038619 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea8ed5-cc8b-42cb-9ac1-2bec53e97c56 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-9b8daabf-fb9d-4739-a02e-bdae33bb3d36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:04.039701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:04.040794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:04.041817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:04.041817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:04.041817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:04.041817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:04.041817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:04.041817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:04.041817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:04.041817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:04.041817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:04.041817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:04.041817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:04.041817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:04.042752 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 287/572] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:04.043459 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8daabf-fb9d-4739-a02e-bdae33bb3d36 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:04.131396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:04.144302 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea8ed5-cc8b-42cb-9ac1-2bec53e97c56 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:04.149639 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8daabf-fb9d-4739-a02e-bdae33bb3d36 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:04.179437 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb6815-78db-40ef-867b-0be496f1a9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:04.180189 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb6815-78db-40ef-867b-0be496f1a9cf None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:04.180472 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb6815-78db-40ef-867b-0be496f1a9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:04.180764 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb6815-78db-40ef-867b-0be496f1a9cf None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:04.181409 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb6815-78db-40ef-867b-0be496f1a9cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:04.181713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb6815-78db-40ef-867b-0be496f1a9cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:04.183080 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb6815-78db-40ef-867b-0be496f1a9cf None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:04.185088 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24a134-12f6-419c-988f-7869a83205d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:04.185733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24a134-12f6-419c-988f-7869a83205d5 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:04.186015 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24a134-12f6-419c-988f-7869a83205d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:04.186309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24a134-12f6-419c-988f-7869a83205d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:04.195394 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 286/573] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:04.196004 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb6815-78db-40ef-867b-0be496f1a9cf None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:04.198256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24a134-12f6-419c-988f-7869a83205d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:04.199694 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24a134-12f6-419c-988f-7869a83205d5 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-1d24a134-12f6-419c-988f-7869a83205d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:04.214593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:04.215729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:04.216791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:04.216791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:04.216791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:04.216791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 288/574] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:04.216791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24a134-12f6-419c-988f-7869a83205d5 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:04.231879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:04.295281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb6815-78db-40ef-867b-0be496f1a9cf None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:04.316662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24a134-12f6-419c-988f-7869a83205d5 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:04.328016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d50bc-d31c-4fe0-83ab-0f679046e6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:04.328654 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d50bc-d31c-4fe0-83ab-0f679046e6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:04.328940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d50bc-d31c-4fe0-83ab-0f679046e6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:04.329229 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d50bc-d31c-4fe0-83ab-0f679046e6e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:04.330210 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d50bc-d31c-4fe0-83ab-0f679046e6e5 None admin] RBAC: Adding query filter params (role.id=e190761ca5494052a96426d0bd344261, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=38f2083bb2a54a9ca22546b5e7aaf032) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:04.330210 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d50bc-d31c-4fe0-83ab-0f679046e6e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:04.331674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d50bc-d31c-4fe0-83ab-0f679046e6e5 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:04.336951 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 287/575] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:04 2022] GET /identity/v3/role_assignments?user.id=38f2083bb2a54a9ca22546b5e7aaf032&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=e190761ca5494052a96426d0bd344261 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:04.337719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d50bc-d31c-4fe0-83ab-0f679046e6e5 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:04.354697 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:04.355770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233218b6-7c35-408a-96e8-20255ead3f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:04.356995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233218b6-7c35-408a-96e8-20255ead3f39 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:04.357373 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233218b6-7c35-408a-96e8-20255ead3f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:04.357584 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233218b6-7c35-408a-96e8-20255ead3f39 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:04.358350 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233218b6-7c35-408a-96e8-20255ead3f39 None admin] RBAC: Adding query filter params (name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:04.358548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233218b6-7c35-408a-96e8-20255ead3f39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:04.360055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233218b6-7c35-408a-96e8-20255ead3f39 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:04.374667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 289/576] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:04.375467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233218b6-7c35-408a-96e8-20255ead3f39 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:04.457601 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d50bc-d31c-4fe0-83ab-0f679046e6e5 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:04.461228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:04.489243 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233218b6-7c35-408a-96e8-20255ead3f39 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:04.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12661538-850e-40b5-b733-7484ab25b9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:04.501674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12661538-850e-40b5-b733-7484ab25b9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:04.502023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12661538-850e-40b5-b733-7484ab25b9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:04.502364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12661538-850e-40b5-b733-7484ab25b9c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:04.516669 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12661538-850e-40b5-b733-7484ab25b9c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-12661538-850e-40b5-b733-7484ab25b9c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:04.522028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:04.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:04.524115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:04.524115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:04.524115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:04.524115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:04.524115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:04.524115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:04.524115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:04.524115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:04.524115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:04.524115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:04.524115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:04.524115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:04.525734 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 288/577] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:04.526526 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12661538-850e-40b5-b733-7484ab25b9c2 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:04.529036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56cbb1-3d91-41e9-af34-c3cb9ee042d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:04.529859 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56cbb1-3d91-41e9-af34-c3cb9ee042d5 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:04.530279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56cbb1-3d91-41e9-af34-c3cb9ee042d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:04.530691 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56cbb1-3d91-41e9-af34-c3cb9ee042d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:04.538012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56cbb1-3d91-41e9-af34-c3cb9ee042d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:04.539452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56cbb1-3d91-41e9-af34-c3cb9ee042d5 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-0c56cbb1-3d91-41e9-af34-c3cb9ee042d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:04.552220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:04.553295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:04.554578 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:04.554578 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:04.554578 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:04.554578 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:04.554578 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:04.554578 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:04.554578 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:04.554578 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:04.559708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 290/578] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:04.560386 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56cbb1-3d91-41e9-af34-c3cb9ee042d5 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:04.602681 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:04.637542 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12661538-850e-40b5-b733-7484ab25b9c2 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:04.667915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56cbb1-3d91-41e9-af34-c3cb9ee042d5 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:04.674458 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684f919-45a1-4c87-85ba-382c5dd8157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:04.675067 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684f919-45a1-4c87-85ba-382c5dd8157d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:04.675343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684f919-45a1-4c87-85ba-382c5dd8157d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:04.675614 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684f919-45a1-4c87-85ba-382c5dd8157d None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:04.676255 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684f919-45a1-4c87-85ba-382c5dd8157d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:04.676584 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684f919-45a1-4c87-85ba-382c5dd8157d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:04.677960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684f919-45a1-4c87-85ba-382c5dd8157d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:04.690086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 289/579] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:04.690907 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684f919-45a1-4c87-85ba-382c5dd8157d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:04.710007 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d7d1b-ca17-41f0-84a4-63ec6744f6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:04.711375 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d7d1b-ca17-41f0-84a4-63ec6744f6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:04.712063 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d7d1b-ca17-41f0-84a4-63ec6744f6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:04.712483 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d7d1b-ca17-41f0-84a4-63ec6744f6b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:04.715073 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:04.725418 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d7d1b-ca17-41f0-84a4-63ec6744f6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:04.726869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d7d1b-ca17-41f0-84a4-63ec6744f6b6 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-c68d7d1b-ca17-41f0-84a4-63ec6744f6b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:04.741611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:04.742575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:04.743471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:04.743471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:04.743471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:04.743471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 291/580] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:04.743471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d7d1b-ca17-41f0-84a4-63ec6744f6b6 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:04.806335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684f919-45a1-4c87-85ba-382c5dd8157d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:04.845317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:04.851179 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a4886-19fa-4777-b37e-f80242c8400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:04.851968 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a4886-19fa-4777-b37e-f80242c8400a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:04.852078 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a4886-19fa-4777-b37e-f80242c8400a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:04.852317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a4886-19fa-4777-b37e-f80242c8400a None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:04.853007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a4886-19fa-4777-b37e-f80242c8400a None admin] RBAC: Adding query filter params (name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:04.853308 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a4886-19fa-4777-b37e-f80242c8400a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:04.854684 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a4886-19fa-4777-b37e-f80242c8400a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:04.855074 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d7d1b-ca17-41f0-84a4-63ec6744f6b6 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:04.867675 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 290/581] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:04.867675 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a4886-19fa-4777-b37e-f80242c8400a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:04.896081 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535233b-1993-44c2-b7d0-24ef87700067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:04.896725 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535233b-1993-44c2-b7d0-24ef87700067 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:04.897096 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535233b-1993-44c2-b7d0-24ef87700067 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:04.897338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535233b-1993-44c2-b7d0-24ef87700067 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:04.897966 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535233b-1993-44c2-b7d0-24ef87700067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:04.898265 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535233b-1993-44c2-b7d0-24ef87700067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:04.899706 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535233b-1993-44c2-b7d0-24ef87700067 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:04.918744 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 292/582] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:04.918744 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535233b-1993-44c2-b7d0-24ef87700067 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:04.965555 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:04.974084 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a4886-19fa-4777-b37e-f80242c8400a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:05.013965 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5ea62-f489-45fe-a904-099bab9f1cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:05.014895 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ea62-f489-45fe-a904-099bab9f1cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:05.015177 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ea62-f489-45fe-a904-099bab9f1cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:05.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ea62-f489-45fe-a904-099bab9f1cd8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:05.020435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535233b-1993-44c2-b7d0-24ef87700067 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:05.023085 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5ea62-f489-45fe-a904-099bab9f1cd8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:05.024534 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5ea62-f489-45fe-a904-099bab9f1cd8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-d2d5ea62-f489-45fe-a904-099bab9f1cd8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:05.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:05.037408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:05.038339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:05.038339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:05.038339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:05.038339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:05.038339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:05.038339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:05.038339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:05.038339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:05.038339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:42:05.038339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:05.038339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 291/583] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:42:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:05.038339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5ea62-f489-45fe-a904-099bab9f1cd8 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:05.060646 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e00b76-5d03-46c7-b57f-15008488bf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:05.061170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e00b76-5d03-46c7-b57f-15008488bf0a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:05.061452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e00b76-5d03-46c7-b57f-15008488bf0a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:05.061735 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e00b76-5d03-46c7-b57f-15008488bf0a None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:05.062380 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e00b76-5d03-46c7-b57f-15008488bf0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:05.062683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e00b76-5d03-46c7-b57f-15008488bf0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:05.064055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e00b76-5d03-46c7-b57f-15008488bf0a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:05.076694 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 293/584] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:05.077471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e00b76-5d03-46c7-b57f-15008488bf0a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:05.102959 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:05.150408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5ea62-f489-45fe-a904-099bab9f1cd8 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:05.184359 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0f9a1-3e15-4334-8654-ce72ce2b0db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:05.185016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0f9a1-3e15-4334-8654-ce72ce2b0db7 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:05.185289 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0f9a1-3e15-4334-8654-ce72ce2b0db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:05.185563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0f9a1-3e15-4334-8654-ce72ce2b0db7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:05.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e00b76-5d03-46c7-b57f-15008488bf0a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:05.195392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:05.196732 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0f9a1-3e15-4334-8654-ce72ce2b0db7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:05.198572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0f9a1-3e15-4334-8654-ce72ce2b0db7 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-13d0f9a1-3e15-4334-8654-ce72ce2b0db7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:05.214510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:05.215504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:05.216994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:05.216994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:05.216994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:05.220930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 292/585] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:05.221776 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0f9a1-3e15-4334-8654-ce72ce2b0db7 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:05.229806 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6b4d6-bf6d-495e-b18e-8438923cc124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:05.230478 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6b4d6-bf6d-495e-b18e-8438923cc124 None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:05.230763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6b4d6-bf6d-495e-b18e-8438923cc124 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:05.231040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6b4d6-bf6d-495e-b18e-8438923cc124 None admin] PATH_INFO: `/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/d494b82a81ca42a69fe7d9efc2f2a251/roles/e190761ca5494052a96426d0bd344261` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:05.248107 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6b4d6-bf6d-495e-b18e-8438923cc124 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d5f67cc330446d1b77c741139f68e15, user_id=d494b82a81ca42a69fe7d9efc2f2a251, role_id=e190761ca5494052a96426d0bd344261)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:05.250200 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6b4d6-bf6d-495e-b18e-8438923cc124 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:05.264215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 294/586] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:42:05 2022] PUT /identity/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/d494b82a81ca42a69fe7d9efc2f2a251/roles/e190761ca5494052a96426d0bd344261 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:42:05.265100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6b4d6-bf6d-495e-b18e-8438923cc124 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:05.343578 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0f9a1-3e15-4334-8654-ce72ce2b0db7 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:05.352478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:05.385725 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46dbc7-b756-4ab3-ae59-82884a937317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:05.386738 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dbc7-b756-4ab3-ae59-82884a937317 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:05.387216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dbc7-b756-4ab3-ae59-82884a937317 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:05.388310 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dbc7-b756-4ab3-ae59-82884a937317 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:05.389325 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46dbc7-b756-4ab3-ae59-82884a937317 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:05.389847 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46dbc7-b756-4ab3-ae59-82884a937317 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:05.391415 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46dbc7-b756-4ab3-ae59-82884a937317 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:05.396334 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6b4d6-bf6d-495e-b18e-8438923cc124 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:05.415820 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 293/587] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Sep 25 00:42:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:05.417035 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46dbc7-b756-4ab3-ae59-82884a937317 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:05.439731 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bdb10-f269-4b02-9ce2-33d225a4f76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:05.440687 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bdb10-f269-4b02-9ce2-33d225a4f76a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:05.441115 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bdb10-f269-4b02-9ce2-33d225a4f76a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:05.442155 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bdb10-f269-4b02-9ce2-33d225a4f76a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:05.454691 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906bdb10-f269-4b02-9ce2-33d225a4f76a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:05.457655 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906bdb10-f269-4b02-9ce2-33d225a4f76a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-906bdb10-f269-4b02-9ce2-33d225a4f76a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:05.472989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:05.474120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:05.475250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:05.475250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:05.475250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:05.475250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:05.475250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:05.475250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:05.475250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:05.475250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:05.475250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 25 00:42:05.475250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:05.479184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 295/588] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:42:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:05.479184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bdb10-f269-4b02-9ce2-33d225a4f76a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:05.503115 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:05.539345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46dbc7-b756-4ab3-ae59-82884a937317 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:05.574989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdacd30-4de6-47c5-852a-74d336418efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:05.576370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdacd30-4de6-47c5-852a-74d336418efc None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:05.576830 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdacd30-4de6-47c5-852a-74d336418efc None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:05.577244 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdacd30-4de6-47c5-852a-74d336418efc None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:05.578086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdacd30-4de6-47c5-852a-74d336418efc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:05.578559 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdacd30-4de6-47c5-852a-74d336418efc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:05.580103 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdacd30-4de6-47c5-852a-74d336418efc None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:05.592188 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 294/589] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:05.596644 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdacd30-4de6-47c5-852a-74d336418efc None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:05.596781 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bdb10-f269-4b02-9ce2-33d225a4f76a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:05.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:05.632897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e5dd6-2e1e-4401-bf00-8004c0475949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:05.633530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e5dd6-2e1e-4401-bf00-8004c0475949 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:05.633816 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e5dd6-2e1e-4401-bf00-8004c0475949 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:05.634143 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e5dd6-2e1e-4401-bf00-8004c0475949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:05.647890 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e5dd6-2e1e-4401-bf00-8004c0475949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:05.649528 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e5dd6-2e1e-4401-bf00-8004c0475949 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-653e5dd6-2e1e-4401-bf00-8004c0475949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:05.665779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:05.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:05.667640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:05.667640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:05.667640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:05.667640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 296/590] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:05.668362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e5dd6-2e1e-4401-bf00-8004c0475949 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:05.712487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdacd30-4de6-47c5-852a-74d336418efc None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:05.742878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:05.752906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533959ae-3760-440f-9ecc-1ca4c564d547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:05.753829 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533959ae-3760-440f-9ecc-1ca4c564d547 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:05.754745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533959ae-3760-440f-9ecc-1ca4c564d547 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:05.755217 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533959ae-3760-440f-9ecc-1ca4c564d547 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:05.756237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533959ae-3760-440f-9ecc-1ca4c564d547 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:05.756778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533959ae-3760-440f-9ecc-1ca4c564d547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:05.758517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533959ae-3760-440f-9ecc-1ca4c564d547 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:05.778817 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 295/591] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Sep 25 00:42:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:05.780006 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533959ae-3760-440f-9ecc-1ca4c564d547 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:05.780115 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e5dd6-2e1e-4401-bf00-8004c0475949 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:05.820741 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493029f-cea2-49f1-a97d-4ed6aaf7b212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:05.822884 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493029f-cea2-49f1-a97d-4ed6aaf7b212 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:05.823172 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493029f-cea2-49f1-a97d-4ed6aaf7b212 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:05.823451 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493029f-cea2-49f1-a97d-4ed6aaf7b212 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:05.832423 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493029f-cea2-49f1-a97d-4ed6aaf7b212 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:05.833992 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493029f-cea2-49f1-a97d-4ed6aaf7b212 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-f493029f-cea2-49f1-a97d-4ed6aaf7b212 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:05.846431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:05.847379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:05.848301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:05.848301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:05.848301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:05.848301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:05.848301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:05.848301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:05.848301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:05.848301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:05.848301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 00:42:05.848301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:05.852181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 297/592] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:05.853141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493029f-cea2-49f1-a97d-4ed6aaf7b212 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:05.875692 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:05.895406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533959ae-3760-440f-9ecc-1ca4c564d547 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:05.932514 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80f372-158d-401a-bc0b-8f94a370483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:05.933347 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f372-158d-401a-bc0b-8f94a370483e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:05.933724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f372-158d-401a-bc0b-8f94a370483e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:05.934095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f372-158d-401a-bc0b-8f94a370483e None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:05.935474 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80f372-158d-401a-bc0b-8f94a370483e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:05.935879 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80f372-158d-401a-bc0b-8f94a370483e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:05.937376 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80f372-158d-401a-bc0b-8f94a370483e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:05.950056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 296/593] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:05.950893 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80f372-158d-401a-bc0b-8f94a370483e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:05.965724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493029f-cea2-49f1-a97d-4ed6aaf7b212 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:05.994275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:06.003828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13b4a6-92cd-4a65-9839-45743b510b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:06.004702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13b4a6-92cd-4a65-9839-45743b510b20 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:06.005128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13b4a6-92cd-4a65-9839-45743b510b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:06.005573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13b4a6-92cd-4a65-9839-45743b510b20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:06.017380 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13b4a6-92cd-4a65-9839-45743b510b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:06.019107 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13b4a6-92cd-4a65-9839-45743b510b20 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-6e13b4a6-92cd-4a65-9839-45743b510b20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:06.041439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:06.042756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:06.044387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:06.044387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:06.044387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:06.048072 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 298/594] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:06.048937 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13b4a6-92cd-4a65-9839-45743b510b20 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:06.067150 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80f372-158d-401a-bc0b-8f94a370483e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:06.104804 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b402a-8f92-4f4e-8740-e316239d903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:06.105755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b402a-8f92-4f4e-8740-e316239d903f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:06.106154 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b402a-8f92-4f4e-8740-e316239d903f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:06.107083 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b402a-8f92-4f4e-8740-e316239d903f None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:06.107908 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b402a-8f92-4f4e-8740-e316239d903f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:06.108415 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b402a-8f92-4f4e-8740-e316239d903f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:06.110072 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b402a-8f92-4f4e-8740-e316239d903f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:06.125289 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:06.129236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 297/595] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Sep 25 00:42:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:06.130195 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b402a-8f92-4f4e-8740-e316239d903f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:06.169300 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13b4a6-92cd-4a65-9839-45743b510b20 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:06.212978 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161aca6a-266a-4725-92a3-8626ad7392e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:06.213954 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aca6a-266a-4725-92a3-8626ad7392e2 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:06.214384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aca6a-266a-4725-92a3-8626ad7392e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:06.214896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aca6a-266a-4725-92a3-8626ad7392e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:06.224434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161aca6a-266a-4725-92a3-8626ad7392e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:06.226530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161aca6a-266a-4725-92a3-8626ad7392e2 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-161aca6a-266a-4725-92a3-8626ad7392e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:06.243246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:06.244371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:06.245471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:06.245471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:06.245471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:06.245471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:06.245471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:06.245471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:06.245471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:06.245471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:06.247027 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b402a-8f92-4f4e-8740-e316239d903f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:06.252509 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 299/596] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:06.253805 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161aca6a-266a-4725-92a3-8626ad7392e2 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:06.284047 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0526d-4614-40b5-a80e-d35c95cfdc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:06.285144 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0526d-4614-40b5-a80e-d35c95cfdc55 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:06.285361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0526d-4614-40b5-a80e-d35c95cfdc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:06.285731 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0526d-4614-40b5-a80e-d35c95cfdc55 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:06.286537 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0526d-4614-40b5-a80e-d35c95cfdc55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:06.286875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0526d-4614-40b5-a80e-d35c95cfdc55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:06.288329 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0526d-4614-40b5-a80e-d35c95cfdc55 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:06.304865 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 298/597] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:06.304865 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0526d-4614-40b5-a80e-d35c95cfdc55 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:06.310479 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:06.365867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:06.388115 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161aca6a-266a-4725-92a3-8626ad7392e2 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:06.410552 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0526d-4614-40b5-a80e-d35c95cfdc55 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:06.431819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe20c7a-7d18-4dec-aa16-4194bda6d43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:06.432768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe20c7a-7d18-4dec-aa16-4194bda6d43c None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:06.433192 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe20c7a-7d18-4dec-aa16-4194bda6d43c None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:06.433721 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe20c7a-7d18-4dec-aa16-4194bda6d43c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:06.449354 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe20c7a-7d18-4dec-aa16-4194bda6d43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:06.451692 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fef1a-11a5-49f7-9e70-006af61d6c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:06.452381 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe20c7a-7d18-4dec-aa16-4194bda6d43c None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:06.452652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fef1a-11a5-49f7-9e70-006af61d6c35 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:06.453044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fef1a-11a5-49f7-9e70-006af61d6c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:06.453455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fef1a-11a5-49f7-9e70-006af61d6c35 None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:06.454312 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fef1a-11a5-49f7-9e70-006af61d6c35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:06.454716 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fef1a-11a5-49f7-9e70-006af61d6c35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:06.457033 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fef1a-11a5-49f7-9e70-006af61d6c35 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-7fe20c7a-7d18-4dec-aa16-4194bda6d43c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:06.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:06.471011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:06.472153 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:06.472153 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:06.472153 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:06.474135 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 300/598] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:06.474265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 299/599] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:06.478099 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fef1a-11a5-49f7-9e70-006af61d6c35 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:06.480164 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe20c7a-7d18-4dec-aa16-4194bda6d43c None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:06.591534 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fef1a-11a5-49f7-9e70-006af61d6c35 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:06.604607 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:06.613150 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:06.615028 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe20c7a-7d18-4dec-aa16-4194bda6d43c None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:06.627783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd2c40-8990-4e28-b69e-0c17d56d3790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:06.628343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2c40-8990-4e28-b69e-0c17d56d3790 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:06.628653 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2c40-8990-4e28-b69e-0c17d56d3790 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:06.628924 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2c40-8990-4e28-b69e-0c17d56d3790 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:06.635701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd2c40-8990-4e28-b69e-0c17d56d3790 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:06.637178 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd2c40-8990-4e28-b69e-0c17d56d3790 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-70fd2c40-8990-4e28-b69e-0c17d56d3790 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:06.648763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:06.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:06.650695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:06.650695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:06.650695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:06.650695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:06.650695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:06.650695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:06.650695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:06.650695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:06.650695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 300/600] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:06.651200 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd2c40-8990-4e28-b69e-0c17d56d3790 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:06.656387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e865301-7279-46c8-81f2-b1ab88415a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:06.657197 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e865301-7279-46c8-81f2-b1ab88415a60 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:06.657475 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e865301-7279-46c8-81f2-b1ab88415a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:06.657748 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e865301-7279-46c8-81f2-b1ab88415a60 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:06.658899 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e865301-7279-46c8-81f2-b1ab88415a60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:06.658899 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e865301-7279-46c8-81f2-b1ab88415a60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:06.660026 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e865301-7279-46c8-81f2-b1ab88415a60 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:06.672575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 301/601] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:06.673643 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274391fe-3d1e-46bf-93d9-2782d984da43 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:06.673981 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274391fe-3d1e-46bf-93d9-2782d984da43 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:06.674509 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274391fe-3d1e-46bf-93d9-2782d984da43 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:06.675572 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 302/602] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:06.676112 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274391fe-3d1e-46bf-93d9-2782d984da43 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:06.764892 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd2c40-8990-4e28-b69e-0c17d56d3790 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:06.785196 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274391fe-3d1e-46bf-93d9-2782d984da43 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:06.798704 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4797f2a-0058-4e6b-a0df-066fdead6cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:06.799355 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797f2a-0058-4e6b-a0df-066fdead6cc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:06.799632 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797f2a-0058-4e6b-a0df-066fdead6cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:06.799904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797f2a-0058-4e6b-a0df-066fdead6cc5 None admin] PATH_INFO: `/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/41cd0c4bf9734339ba9e8f2dabb9a0ad/roles/e190761ca5494052a96426d0bd344261` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:06.818180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4797f2a-0058-4e6b-a0df-066fdead6cc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d5f67cc330446d1b77c741139f68e15, user_id=41cd0c4bf9734339ba9e8f2dabb9a0ad, role_id=e190761ca5494052a96426d0bd344261)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:06.819699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4797f2a-0058-4e6b-a0df-066fdead6cc5 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:06.826331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dd5fe-029b-4954-b437-09be2ce1f83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:06.826758 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dd5fe-029b-4954-b437-09be2ce1f83d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:06.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dd5fe-029b-4954-b437-09be2ce1f83d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:06.827504 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dd5fe-029b-4954-b437-09be2ce1f83d None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:06.828272 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dd5fe-029b-4954-b437-09be2ce1f83d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:06.828638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dd5fe-029b-4954-b437-09be2ce1f83d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:06.830069 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dd5fe-029b-4954-b437-09be2ce1f83d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:06.833377 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 301/603] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:42:06 2022] PUT /identity/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/41cd0c4bf9734339ba9e8f2dabb9a0ad/roles/e190761ca5494052a96426d0bd344261 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:42:06.834270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4797f2a-0058-4e6b-a0df-066fdead6cc5 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:06.854157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 303/604] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:06.856885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70c67e-c108-44ac-a268-a969c8a396b5 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:06.857427 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70c67e-c108-44ac-a268-a969c8a396b5 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:06.857926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70c67e-c108-44ac-a268-a969c8a396b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:06.874558 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:06.885830 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-6a70c67e-c108-44ac-a268-a969c8a396b5 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:06.888714 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-6a70c67e-c108-44ac-a268-a969c8a396b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:06.902172 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:06.964826 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4797f2a-0058-4e6b-a0df-066fdead6cc5 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:06.990376 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 304/605] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:06.991579 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70c67e-c108-44ac-a268-a969c8a396b5 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:07.020711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b156a-d64d-4746-a129-4017f02871e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:07.021358 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b156a-d64d-4746-a129-4017f02871e7 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:07.021635 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b156a-d64d-4746-a129-4017f02871e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:07.021908 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b156a-d64d-4746-a129-4017f02871e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:07.032745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b156a-d64d-4746-a129-4017f02871e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:07.034476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b156a-d64d-4746-a129-4017f02871e7 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-7c7b156a-d64d-4746-a129-4017f02871e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:07.046898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:07.047802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:07.048701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:07.048701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:07.048701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:07.048701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:07.048701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:07.048701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:07.048701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:07.048701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:07.051071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 302/606] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:07.056299 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b156a-d64d-4746-a129-4017f02871e7 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:07.106367 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70c67e-c108-44ac-a268-a969c8a396b5 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:07.143491 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5b8d9-a35f-4d97-afc6-60984624fdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:07.144049 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b8d9-a35f-4d97-afc6-60984624fdee None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:07.144332 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b8d9-a35f-4d97-afc6-60984624fdee None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:07.144627 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b8d9-a35f-4d97-afc6-60984624fdee None admin] PATH_INFO: `/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/94b2d0afc3294d75897dda3dd8f78aed/roles/e190761ca5494052a96426d0bd344261` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:07.157479 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:07.159653 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:07.161250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5b8d9-a35f-4d97-afc6-60984624fdee None admin] RBAC: Authorizing `identity:create_grant(project_id=9d5f67cc330446d1b77c741139f68e15, user_id=94b2d0afc3294d75897dda3dd8f78aed, role_id=e190761ca5494052a96426d0bd344261)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:07.162703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5b8d9-a35f-4d97-afc6-60984624fdee None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:07.172527 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b156a-d64d-4746-a129-4017f02871e7 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:07.184990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 305/607] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:42:06 2022] PUT /identity/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/94b2d0afc3294d75897dda3dd8f78aed/roles/e190761ca5494052a96426d0bd344261 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:42:07.211470 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7c4b2-de02-4d65-8f2f-587190c12fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:07.212096 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7c4b2-de02-4d65-8f2f-587190c12fba None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:07.212371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7c4b2-de02-4d65-8f2f-587190c12fba None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:07.212677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7c4b2-de02-4d65-8f2f-587190c12fba None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:07.213400 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7c4b2-de02-4d65-8f2f-587190c12fba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:07.213692 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7c4b2-de02-4d65-8f2f-587190c12fba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:07.215160 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7c4b2-de02-4d65-8f2f-587190c12fba None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:07.229311 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 303/608] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:07.235267 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5b8d9-a35f-4d97-afc6-60984624fdee None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:07.334799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7c4b2-de02-4d65-8f2f-587190c12fba None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:07.370508 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5b8d9-a35f-4d97-afc6-60984624fdee None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:07.415555 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d3667-430e-4205-94ba-2f959d3d1093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:07.416467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d3667-430e-4205-94ba-2f959d3d1093 None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:07.417028 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d3667-430e-4205-94ba-2f959d3d1093 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:07.417495 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d3667-430e-4205-94ba-2f959d3d1093 None admin] PATH_INFO: `/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/42a2f85512e648698fdc7ab7cac75752/roles/e190761ca5494052a96426d0bd344261` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:07.436804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d3667-430e-4205-94ba-2f959d3d1093 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d5f67cc330446d1b77c741139f68e15, user_id=42a2f85512e648698fdc7ab7cac75752, role_id=e190761ca5494052a96426d0bd344261)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:07.438917 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d3667-430e-4205-94ba-2f959d3d1093 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:07.448607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7c4b2-de02-4d65-8f2f-587190c12fba None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:07.472603 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 306/609] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:42:07 2022] PUT /identity/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/42a2f85512e648698fdc7ab7cac75752/roles/e190761ca5494052a96426d0bd344261 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:42:07.503260 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd748e6-ccca-4f73-a274-ec48fa860346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:07.504015 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd748e6-ccca-4f73-a274-ec48fa860346 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:07.504364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd748e6-ccca-4f73-a274-ec48fa860346 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:07.504850 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd748e6-ccca-4f73-a274-ec48fa860346 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:07.522433 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd748e6-ccca-4f73-a274-ec48fa860346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-0cd748e6-ccca-4f73-a274-ec48fa860346 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:07.528476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:07.529677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:07.530707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:07.530707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:07.530707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:07.530707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:07.530707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:07.530707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:07.530707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:07.530707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:07.530707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:07.530707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:07.530707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:07.530707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:07.533279 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 304/610] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:07.539142 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d3667-430e-4205-94ba-2f959d3d1093 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:07.591191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:07.656363 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173e096-dd09-4d3f-b195-9b93927c30f8 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:07.656735 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173e096-dd09-4d3f-b195-9b93927c30f8 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:07.656946 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173e096-dd09-4d3f-b195-9b93927c30f8 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:07.658436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 305/611] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:07.664344 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35941e-8290-47a6-b6e9-f1eaaab79ba4 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:07.665062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35941e-8290-47a6-b6e9-f1eaaab79ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:07.665553 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35941e-8290-47a6-b6e9-f1eaaab79ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:07.684475 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d3667-430e-4205-94ba-2f959d3d1093 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:07.687182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-fb35941e-8290-47a6-b6e9-f1eaaab79ba4 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:07.688731 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-fb35941e-8290-47a6-b6e9-f1eaaab79ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:07.694034 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:07.740802 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34861d-762d-4830-ae63-7565a2ac539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:07.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34861d-762d-4830-ae63-7565a2ac539a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:07.741693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34861d-762d-4830-ae63-7565a2ac539a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:07.741959 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34861d-762d-4830-ae63-7565a2ac539a None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:07.742622 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34861d-762d-4830-ae63-7565a2ac539a None admin] RBAC: Adding query filter params (name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:07.742921 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34861d-762d-4830-ae63-7565a2ac539a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:07.744286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34861d-762d-4830-ae63-7565a2ac539a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:07.755348 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 307/612] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:42:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:07.761326 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34861d-762d-4830-ae63-7565a2ac539a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:07.787828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 306/613] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:42:07.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34861d-762d-4830-ae63-7565a2ac539a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:07.887069 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:07.920239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f74604-6a8a-47da-8aa8-8556c84e1302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:07.921275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f74604-6a8a-47da-8aa8-8556c84e1302 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:07.921781 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f74604-6a8a-47da-8aa8-8556c84e1302 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:07.922262 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f74604-6a8a-47da-8aa8-8556c84e1302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:07.933352 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f74604-6a8a-47da-8aa8-8556c84e1302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:07.935176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f74604-6a8a-47da-8aa8-8556c84e1302 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-18f74604-6a8a-47da-8aa8-8556c84e1302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:07.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:07.951523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:07.952383 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:07.952383 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:07.952383 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:07.958823 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 308/614] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:07.960423 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35941e-8290-47a6-b6e9-f1eaaab79ba4 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:08.072598 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35941e-8290-47a6-b6e9-f1eaaab79ba4 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:08.117675 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558efdb-eff4-4543-a0e8-ba457edea5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:08.118642 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558efdb-eff4-4543-a0e8-ba457edea5ca None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:08.119123 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558efdb-eff4-4543-a0e8-ba457edea5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:08.119595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558efdb-eff4-4543-a0e8-ba457edea5ca None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:08.120468 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558efdb-eff4-4543-a0e8-ba457edea5ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:08.121005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558efdb-eff4-4543-a0e8-ba457edea5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:08.122617 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558efdb-eff4-4543-a0e8-ba457edea5ca None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:08.132148 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:08.140643 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 307/615] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:08.142235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f74604-6a8a-47da-8aa8-8556c84e1302 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:08.148091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558efdb-eff4-4543-a0e8-ba457edea5ca None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:08.307057 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558efdb-eff4-4543-a0e8-ba457edea5ca None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:08.329529 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f74604-6a8a-47da-8aa8-8556c84e1302 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:08.347131 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310aa34f-0a16-4871-bc41-972f33070574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:08.348133 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310aa34f-0a16-4871-bc41-972f33070574 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:08.348676 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310aa34f-0a16-4871-bc41-972f33070574 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:08.349164 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310aa34f-0a16-4871-bc41-972f33070574 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:08.357071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310aa34f-0a16-4871-bc41-972f33070574 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:08.358897 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310aa34f-0a16-4871-bc41-972f33070574 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-310aa34f-0a16-4871-bc41-972f33070574 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:08.372192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:08.373226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:08.374146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:08.374146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:08.374146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:08.374146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:08.374146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:08.374146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:08.374146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:08.374146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:08.374146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:42:08.374146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:08.380692 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 308/616] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:42:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:08.382784 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310aa34f-0a16-4871-bc41-972f33070574 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:08.409991 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c05c7-e5ba-4f7a-b7c4-f122cff91e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:08.410648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c05c7-e5ba-4f7a-b7c4-f122cff91e06 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:08.410928 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c05c7-e5ba-4f7a-b7c4-f122cff91e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:08.411207 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c05c7-e5ba-4f7a-b7c4-f122cff91e06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:08.436728 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c05c7-e5ba-4f7a-b7c4-f122cff91e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-b29c05c7-e5ba-4f7a-b7c4-f122cff91e06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:08.444236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:08.445211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:08.446019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:08.446019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:08.446019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:08.446019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:08.446019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:08.446019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:08.446019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:08.446019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:08.446019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:08.446019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:08.446019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:08.446019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:08.451723 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 309/617] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:08.456498 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c05c7-e5ba-4f7a-b7c4-f122cff91e06 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:08.481753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:08.496313 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:08.541805 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310aa34f-0a16-4871-bc41-972f33070574 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:08.579200 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc7beb-b049-42f3-9347-7e3f1114a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:08.580224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc7beb-b049-42f3-9347-7e3f1114a476 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:08.580759 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc7beb-b049-42f3-9347-7e3f1114a476 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:08.581242 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc7beb-b049-42f3-9347-7e3f1114a476 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:08.582276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc7beb-b049-42f3-9347-7e3f1114a476 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:08.582825 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc7beb-b049-42f3-9347-7e3f1114a476 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:08.584594 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc7beb-b049-42f3-9347-7e3f1114a476 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:08.596151 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c05c7-e5ba-4f7a-b7c4-f122cff91e06 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:08.608693 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 309/618] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Sep 25 00:42:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:08.611819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc7beb-b049-42f3-9347-7e3f1114a476 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:08.661445 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eff4f-8cac-4863-9bdd-e5c9241cf796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:08.662073 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eff4f-8cac-4863-9bdd-e5c9241cf796 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:08.662355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eff4f-8cac-4863-9bdd-e5c9241cf796 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:08.662633 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eff4f-8cac-4863-9bdd-e5c9241cf796 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:08.663309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787eff4f-8cac-4863-9bdd-e5c9241cf796 None admin] RBAC: Adding query filter params (name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:08.663614 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787eff4f-8cac-4863-9bdd-e5c9241cf796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:08.665039 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787eff4f-8cac-4863-9bdd-e5c9241cf796 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:08.679730 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 310/619] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:42:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:08.685817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eff4f-8cac-4863-9bdd-e5c9241cf796 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:08.749677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc7beb-b049-42f3-9347-7e3f1114a476 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:08.785156 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:08.819920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901bbea-33e5-47b2-9ec9-ec477b308668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:08.821927 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901bbea-33e5-47b2-9ec9-ec477b308668 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:08.822419 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901bbea-33e5-47b2-9ec9-ec477b308668 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:08.822900 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901bbea-33e5-47b2-9ec9-ec477b308668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:08.845169 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:08.845945 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901bbea-33e5-47b2-9ec9-ec477b308668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:08.847439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901bbea-33e5-47b2-9ec9-ec477b308668 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-2901bbea-33e5-47b2-9ec9-ec477b308668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:08.879036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:08.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:08.880940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:08.880940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:08.880940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:08.886727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 310/620] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:08.889465 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901bbea-33e5-47b2-9ec9-ec477b308668 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:08.897496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eff4f-8cac-4863-9bdd-e5c9241cf796 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:08.939534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187196a-84c4-4e05-b80e-99bd463898f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:08.940198 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187196a-84c4-4e05-b80e-99bd463898f9 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:08.940479 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187196a-84c4-4e05-b80e-99bd463898f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:08.940792 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187196a-84c4-4e05-b80e-99bd463898f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:08.951816 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187196a-84c4-4e05-b80e-99bd463898f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:08.953629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187196a-84c4-4e05-b80e-99bd463898f9 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-e187196a-84c4-4e05-b80e-99bd463898f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:08.969078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:08.970038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:08.970926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:08.970926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:08.970926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:08.970926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 311/621] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:08.981717 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187196a-84c4-4e05-b80e-99bd463898f9 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:09.111121 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187196a-84c4-4e05-b80e-99bd463898f9 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:09.134488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901bbea-33e5-47b2-9ec9-ec477b308668 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:09.144284 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:09.147787 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d3f49-df11-4c7d-be6f-48fedc025011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:09.148405 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d3f49-df11-4c7d-be6f-48fedc025011 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:09.149129 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d3f49-df11-4c7d-be6f-48fedc025011 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:09.149435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d3f49-df11-4c7d-be6f-48fedc025011 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:09.150087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d3f49-df11-4c7d-be6f-48fedc025011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:09.150451 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d3f49-df11-4c7d-be6f-48fedc025011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:09.151829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d3f49-df11-4c7d-be6f-48fedc025011 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:09.165759 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 312/622] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:09.171476 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d3f49-df11-4c7d-be6f-48fedc025011 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:09.212806 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745c27e-07b9-4046-8c03-025952c2572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:09.214457 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745c27e-07b9-4046-8c03-025952c2572b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:09.214943 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745c27e-07b9-4046-8c03-025952c2572b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:09.216603 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745c27e-07b9-4046-8c03-025952c2572b None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:09.217479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745c27e-07b9-4046-8c03-025952c2572b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:09.218149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745c27e-07b9-4046-8c03-025952c2572b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:09.220764 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745c27e-07b9-4046-8c03-025952c2572b None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:09.245835 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 311/623] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:09.254565 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745c27e-07b9-4046-8c03-025952c2572b None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:09.287475 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:09.338609 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d3f49-df11-4c7d-be6f-48fedc025011 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:09.389683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad6ea2-3433-423a-bd7c-dce8e83d6ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:09.391923 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad6ea2-3433-423a-bd7c-dce8e83d6ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:09.392206 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad6ea2-3433-423a-bd7c-dce8e83d6ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:09.392485 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad6ea2-3433-423a-bd7c-dce8e83d6ea1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:09.395643 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745c27e-07b9-4046-8c03-025952c2572b None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:09.410993 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad6ea2-3433-423a-bd7c-dce8e83d6ea1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:09.412507 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad6ea2-3433-423a-bd7c-dce8e83d6ea1 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-d6ad6ea2-3433-423a-bd7c-dce8e83d6ea1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:09.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:09.441599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:09.442535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:09.442535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:09.442535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:09.442535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:09.442535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:09.442535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:09.442535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:09.442535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:09.442535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:42:09.442535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:09.444332 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 313/624] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Sep 25 00:42:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:09.451254 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad6ea2-3433-423a-bd7c-dce8e83d6ea1 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:09.475280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8079f-9597-497d-948f-50a40522a30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:09.475924 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8079f-9597-497d-948f-50a40522a30e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:09.477182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8079f-9597-497d-948f-50a40522a30e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:09.477395 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8079f-9597-497d-948f-50a40522a30e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:09.491297 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8079f-9597-497d-948f-50a40522a30e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:09.493139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8079f-9597-497d-948f-50a40522a30e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-a8d8079f-9597-497d-948f-50a40522a30e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:09.515867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:09.516916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:09.517769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:09.517769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:09.517769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:09.517769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:09.517769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:09.517769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:09.517769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:09.517769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:09.525356 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 312/625] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:09.530903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8079f-9597-497d-948f-50a40522a30e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:09.556712 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:09.613298 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad6ea2-3433-423a-bd7c-dce8e83d6ea1 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:09.638204 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:09.648836 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8079f-9597-497d-948f-50a40522a30e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:09.651269 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d44c1a-9385-4833-9e14-1d7dc6bb438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:09.652522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d44c1a-9385-4833-9e14-1d7dc6bb438f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:09.652522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d44c1a-9385-4833-9e14-1d7dc6bb438f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:09.653408 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d44c1a-9385-4833-9e14-1d7dc6bb438f None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:09.654011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d44c1a-9385-4833-9e14-1d7dc6bb438f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:09.654319 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d44c1a-9385-4833-9e14-1d7dc6bb438f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:09.655765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d44c1a-9385-4833-9e14-1d7dc6bb438f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:09.675087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 314/626] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Sep 25 00:42:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:09.676451 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb515-34e4-4cf0-a17c-f461ea08b1a3 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:09.676768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb515-34e4-4cf0-a17c-f461ea08b1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:09.677098 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb515-34e4-4cf0-a17c-f461ea08b1a3 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:09.682658 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 315/627] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:09.683293 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fb515-34e4-4cf0-a17c-f461ea08b1a3 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:09.688074 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16b039-79a4-46e9-bf58-d14468052839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:09.688979 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b039-79a4-46e9-bf58-d14468052839 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:09.689438 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b039-79a4-46e9-bf58-d14468052839 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:09.689890 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b039-79a4-46e9-bf58-d14468052839 None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:09.690786 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16b039-79a4-46e9-bf58-d14468052839 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:09.691286 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16b039-79a4-46e9-bf58-d14468052839 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:09.693021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16b039-79a4-46e9-bf58-d14468052839 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:09.712106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 313/628] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:09.713863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b10414-ba0a-44f5-ab0f-8757dd3d3d71 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:09.714466 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b10414-ba0a-44f5-ab0f-8757dd3d3d71 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:09.714919 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b10414-ba0a-44f5-ab0f-8757dd3d3d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:09.734389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-57b10414-ba0a-44f5-ab0f-8757dd3d3d71 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:09.735960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-57b10414-ba0a-44f5-ab0f-8757dd3d3d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:09.799530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fb515-34e4-4cf0-a17c-f461ea08b1a3 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:09.810539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:09.814710 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 314/629] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:09.815848 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b10414-ba0a-44f5-ab0f-8757dd3d3d71 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:09.862645 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca9e71-88da-4811-9348-8e998b0f8404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:09.863269 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca9e71-88da-4811-9348-8e998b0f8404 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:09.863552 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca9e71-88da-4811-9348-8e998b0f8404 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:09.863829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca9e71-88da-4811-9348-8e998b0f8404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:09.903323 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:09.924349 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b10414-ba0a-44f5-ab0f-8757dd3d3d71 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:09.957976 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca9e71-88da-4811-9348-8e998b0f8404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:09.960287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca9e71-88da-4811-9348-8e998b0f8404 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:09.963674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61f85c-25fa-4156-b4cb-b4a890cba573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:09.964346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61f85c-25fa-4156-b4cb-b4a890cba573 None admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:09.964663 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61f85c-25fa-4156-b4cb-b4a890cba573 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:09.964942 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61f85c-25fa-4156-b4cb-b4a890cba573 None admin] PATH_INFO: `/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/38f2083bb2a54a9ca22546b5e7aaf032/roles/e190761ca5494052a96426d0bd344261` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:09.980532 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61f85c-25fa-4156-b4cb-b4a890cba573 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d5f67cc330446d1b77c741139f68e15, user_id=38f2083bb2a54a9ca22546b5e7aaf032, role_id=e190761ca5494052a96426d0bd344261)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:09.982109 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61f85c-25fa-4156-b4cb-b4a890cba573 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:10.003474 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 315/630] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:42:09 2022] PUT /identity/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/38f2083bb2a54a9ca22546b5e7aaf032/roles/e190761ca5494052a96426d0bd344261 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:42:10.003474 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168736b-9424-43c3-8cc4-07c86ae2a781 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:10.003474 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168736b-9424-43c3-8cc4-07c86ae2a781 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:10.003474 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168736b-9424-43c3-8cc4-07c86ae2a781 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:10.003474 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 316/631] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:10.014385 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930383a2-fbb3-4a6c-aa4b-9c2154971569 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:10.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930383a2-fbb3-4a6c-aa4b-9c2154971569 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:10.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930383a2-fbb3-4a6c-aa4b-9c2154971569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:10.057162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-930383a2-fbb3-4a6c-aa4b-9c2154971569 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:10.058212 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-930383a2-fbb3-4a6c-aa4b-9c2154971569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:10.094389 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 316/632] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:42:10.100968 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca9e71-88da-4811-9348-8e998b0f8404 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:10.113075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:10.182449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 317/633] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:10.183245 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930383a2-fbb3-4a6c-aa4b-9c2154971569 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:10.283309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:10.290562 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca9e71-88da-4811-9348-8e998b0f8404 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:10.329851 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930383a2-fbb3-4a6c-aa4b-9c2154971569 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:10.331661 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f682e9-6a14-4e96-b3a7-ee2bd4f36996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:10.332424 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f682e9-6a14-4e96-b3a7-ee2bd4f36996 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:10.332735 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f682e9-6a14-4e96-b3a7-ee2bd4f36996 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:10.333012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f682e9-6a14-4e96-b3a7-ee2bd4f36996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:10.343891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f682e9-6a14-4e96-b3a7-ee2bd4f36996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:10.345375 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f682e9-6a14-4e96-b3a7-ee2bd4f36996 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-96f682e9-6a14-4e96-b3a7-ee2bd4f36996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:10.363733 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:10.364720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:10.365620 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:10.365620 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:10.365620 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:10.365620 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 317/634] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:10.366395 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feb254-eac0-4d09-8ce8-a60f1f5d1af1 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:10.366686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feb254-eac0-4d09-8ce8-a60f1f5d1af1 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:10.366965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feb254-eac0-4d09-8ce8-a60f1f5d1af1 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:10.369956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 318/635] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:10.373629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feb254-eac0-4d09-8ce8-a60f1f5d1af1 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:10.383235 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be9268-dc80-48b5-9546-ae8c472c30f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:10.384140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be9268-dc80-48b5-9546-ae8c472c30f4 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:10.384634 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be9268-dc80-48b5-9546-ae8c472c30f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:10.385084 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be9268-dc80-48b5-9546-ae8c472c30f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:10.399115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be9268-dc80-48b5-9546-ae8c472c30f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-94be9268-dc80-48b5-9546-ae8c472c30f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:10.406044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:10.406960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:10.407774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:10.407774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:10.407774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:10.407774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:10.407774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:10.407774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:10.407774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:10.407774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:10.407774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:10.407774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:10.407774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:10.407774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:10.410653 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 318/636] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:10.412278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcc906-87c5-4dbf-8239-59c394a55aa9 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:10.412841 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcc906-87c5-4dbf-8239-59c394a55aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:10.413677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcc906-87c5-4dbf-8239-59c394a55aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:10.435163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-2fbcc906-87c5-4dbf-8239-59c394a55aa9 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:10.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-2fbcc906-87c5-4dbf-8239-59c394a55aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:10.454960 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:10.502789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feb254-eac0-4d09-8ce8-a60f1f5d1af1 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:10.515210 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 319/637] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:10.516057 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcc906-87c5-4dbf-8239-59c394a55aa9 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:10.548694 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99464659-8783-4d7e-bd28-2d4aba24baa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:10.549950 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99464659-8783-4d7e-bd28-2d4aba24baa3 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:10.550616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99464659-8783-4d7e-bd28-2d4aba24baa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:10.551035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99464659-8783-4d7e-bd28-2d4aba24baa3 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:10.551973 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99464659-8783-4d7e-bd28-2d4aba24baa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:10.552436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99464659-8783-4d7e-bd28-2d4aba24baa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:10.554056 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99464659-8783-4d7e-bd28-2d4aba24baa3 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:10.567578 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 319/638] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:10.568759 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99464659-8783-4d7e-bd28-2d4aba24baa3 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:10.577583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:10.638705 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcc906-87c5-4dbf-8239-59c394a55aa9 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:10.674212 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efbff3-0048-4188-9501-c71c5fc9227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:10.674975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efbff3-0048-4188-9501-c71c5fc9227a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:10.675353 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efbff3-0048-4188-9501-c71c5fc9227a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:10.675725 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efbff3-0048-4188-9501-c71c5fc9227a None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:10.676514 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efbff3-0048-4188-9501-c71c5fc9227a None admin] RBAC: Adding query filter params (name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:10.676935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efbff3-0048-4188-9501-c71c5fc9227a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:10.678396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efbff3-0048-4188-9501-c71c5fc9227a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:10.686964 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 320/639] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:10.687876 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efbff3-0048-4188-9501-c71c5fc9227a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:10.689704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99464659-8783-4d7e-bd28-2d4aba24baa3 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:10.719386 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:10.739381 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b55c3-f64b-4fa0-b8d8-80794bb93991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:10.740210 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b55c3-f64b-4fa0-b8d8-80794bb93991 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:10.740924 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b55c3-f64b-4fa0-b8d8-80794bb93991 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:10.741375 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b55c3-f64b-4fa0-b8d8-80794bb93991 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:10.756783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b55c3-f64b-4fa0-b8d8-80794bb93991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-ba3b55c3-f64b-4fa0-b8d8-80794bb93991 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:10.761600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:10.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:10.763855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:10.763855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:10.763855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:10.763855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:10.763855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:10.763855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:10.763855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:10.763855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:10.763855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:10.763855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:10.763855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:10.763855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:10.768711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 320/640] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:10.768711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b55c3-f64b-4fa0-b8d8-80794bb93991 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:10.809252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efbff3-0048-4188-9501-c71c5fc9227a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:10.831660 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:10.860328 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d43e2-7fc8-441b-9997-837acb12ca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:10.861105 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d43e2-7fc8-441b-9997-837acb12ca64 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:10.861395 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d43e2-7fc8-441b-9997-837acb12ca64 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:10.861674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d43e2-7fc8-441b-9997-837acb12ca64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:10.868704 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d43e2-7fc8-441b-9997-837acb12ca64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:10.870147 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d43e2-7fc8-441b-9997-837acb12ca64 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-6e1d43e2-7fc8-441b-9997-837acb12ca64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:10.882499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:10.883369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:10.884237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:10.884237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:10.884237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:10.884237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:10.884237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:10.884237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:10.884237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:10.884237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:10.884237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 321/641] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:10.884764 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d43e2-7fc8-441b-9997-837acb12ca64 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:10.899393 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b55c3-f64b-4fa0-b8d8-80794bb93991 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:10.935109 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed81db-f819-4483-91e8-2aad55841797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:10.935759 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed81db-f819-4483-91e8-2aad55841797 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:10.936031 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed81db-f819-4483-91e8-2aad55841797 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:10.936293 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed81db-f819-4483-91e8-2aad55841797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:10.951685 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed81db-f819-4483-91e8-2aad55841797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:10.953106 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed81db-f819-4483-91e8-2aad55841797 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-6eed81db-f819-4483-91e8-2aad55841797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:10.968158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:10.969616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:10.971309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:10.971309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:10.971309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:10.973001 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 321/642] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:10.974193 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed81db-f819-4483-91e8-2aad55841797 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:10.994790 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d43e2-7fc8-441b-9997-837acb12ca64 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:11.008817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:11.030694 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e49d2-b96a-4ea7-bbbf-1ad068bfc3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:11.031400 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e49d2-b96a-4ea7-bbbf-1ad068bfc3fc None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:11.031586 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e49d2-b96a-4ea7-bbbf-1ad068bfc3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:11.031857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e49d2-b96a-4ea7-bbbf-1ad068bfc3fc None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:11.032524 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e49d2-b96a-4ea7-bbbf-1ad068bfc3fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:11.032934 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e49d2-b96a-4ea7-bbbf-1ad068bfc3fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:11.034213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e49d2-b96a-4ea7-bbbf-1ad068bfc3fc None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:11.044710 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 322/643] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:11.045620 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e49d2-b96a-4ea7-bbbf-1ad068bfc3fc None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:11.082305 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:11.092965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed81db-f819-4483-91e8-2aad55841797 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:11.129049 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b79969-3199-4b11-8a3a-db725c1c8e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:11.129767 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79969-3199-4b11-8a3a-db725c1c8e99 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:11.130060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79969-3199-4b11-8a3a-db725c1c8e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:11.130335 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79969-3199-4b11-8a3a-db725c1c8e99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:11.141327 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b79969-3199-4b11-8a3a-db725c1c8e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-13b79969-3199-4b11-8a3a-db725c1c8e99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:11.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:11.147653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:11.149011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:11.149011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:11.149011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:11.149011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:11.149011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:11.149011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:11.149011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:11.149011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:11.149011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:11.149011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:11.149011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:11.149011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:11.150027 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e49d2-b96a-4ea7-bbbf-1ad068bfc3fc None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:11.153797 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 322/644] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:11.153797 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b79969-3199-4b11-8a3a-db725c1c8e99 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:11.185177 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0535-bda2-4327-9054-6fb92636b459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:11.185857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0535-bda2-4327-9054-6fb92636b459 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:11.186201 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0535-bda2-4327-9054-6fb92636b459 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:11.186544 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0535-bda2-4327-9054-6fb92636b459 None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:11.187296 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a0535-bda2-4327-9054-6fb92636b459 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:11.187674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a0535-bda2-4327-9054-6fb92636b459 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:11.189207 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a0535-bda2-4327-9054-6fb92636b459 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:11.201577 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 323/645] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:11.202497 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0535-bda2-4327-9054-6fb92636b459 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:11.255585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:11.266040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b79969-3199-4b11-8a3a-db725c1c8e99 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:11.302908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00b19a-c45b-4254-b7e3-096775e0bb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:11.303556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:11.303789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00b19a-c45b-4254-b7e3-096775e0bb2c None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:11.304199 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00b19a-c45b-4254-b7e3-096775e0bb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:11.304577 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00b19a-c45b-4254-b7e3-096775e0bb2c None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:11.305690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00b19a-c45b-4254-b7e3-096775e0bb2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:11.306120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00b19a-c45b-4254-b7e3-096775e0bb2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:11.307645 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00b19a-c45b-4254-b7e3-096775e0bb2c None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:11.311127 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0535-bda2-4327-9054-6fb92636b459 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:11.319852 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 323/646] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:11.320645 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00b19a-c45b-4254-b7e3-096775e0bb2c None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:11.352322 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d047c5-f1b4-41ff-b630-cb1b93715216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:11.352989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d047c5-f1b4-41ff-b630-cb1b93715216 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:11.353271 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d047c5-f1b4-41ff-b630-cb1b93715216 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:11.353551 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d047c5-f1b4-41ff-b630-cb1b93715216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:11.364459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d047c5-f1b4-41ff-b630-cb1b93715216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:11.365940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d047c5-f1b4-41ff-b630-cb1b93715216 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-e8d047c5-f1b4-41ff-b630-cb1b93715216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:11.381071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:11.382248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:11.383134 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:11.383134 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:11.383134 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:11.383134 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 324/647] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:11.383134 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d047c5-f1b4-41ff-b630-cb1b93715216 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:11.431534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00b19a-c45b-4254-b7e3-096775e0bb2c None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:11.467797 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f3dcc-dc70-4220-95d7-f65b085e7d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:11.468483 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f3dcc-dc70-4220-95d7-f65b085e7d8a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:11.469068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f3dcc-dc70-4220-95d7-f65b085e7d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:11.469345 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f3dcc-dc70-4220-95d7-f65b085e7d8a None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:11.470001 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f3dcc-dc70-4220-95d7-f65b085e7d8a None admin] RBAC: Adding query filter params (name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:11.470300 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f3dcc-dc70-4220-95d7-f65b085e7d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:11.472082 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f3dcc-dc70-4220-95d7-f65b085e7d8a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:11.484644 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 324/648] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:42:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:11.484644 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f3dcc-dc70-4220-95d7-f65b085e7d8a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:11.488745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d047c5-f1b4-41ff-b630-cb1b93715216 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:11.501956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:11.522794 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02926f0-6ec3-4bb9-bca9-d779af0fced6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:11.523407 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02926f0-6ec3-4bb9-bca9-d779af0fced6 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:11.523687 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02926f0-6ec3-4bb9-bca9-d779af0fced6 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:11.523962 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02926f0-6ec3-4bb9-bca9-d779af0fced6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:11.524715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02926f0-6ec3-4bb9-bca9-d779af0fced6 None admin] RBAC: Adding query filter params (role.id=e190761ca5494052a96426d0bd344261, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=d494b82a81ca42a69fe7d9efc2f2a251) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:11.525028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02926f0-6ec3-4bb9-bca9-d779af0fced6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:11.526496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02926f0-6ec3-4bb9-bca9-d779af0fced6 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:11.540587 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 325/649] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:11 2022] GET /identity/v3/role_assignments?user.id=d494b82a81ca42a69fe7d9efc2f2a251&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=e190761ca5494052a96426d0bd344261 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:11.540587 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02926f0-6ec3-4bb9-bca9-d779af0fced6 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:11.553110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:11.616755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f3dcc-dc70-4220-95d7-f65b085e7d8a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:11.657038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014b653-8202-4b4e-92ac-bbe3f93f9752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:11.657849 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014b653-8202-4b4e-92ac-bbe3f93f9752 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:11.658282 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014b653-8202-4b4e-92ac-bbe3f93f9752 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:11.658677 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014b653-8202-4b4e-92ac-bbe3f93f9752 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:11.667438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014b653-8202-4b4e-92ac-bbe3f93f9752 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:11.669328 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014b653-8202-4b4e-92ac-bbe3f93f9752 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:11.674141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02926f0-6ec3-4bb9-bca9-d779af0fced6 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-8014b653-8202-4b4e-92ac-bbe3f93f9752 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:11.683678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:11.684765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:11.685689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:11.685689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:11.685689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:11.685689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:11.685689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:11.685689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:11.685689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:11.685689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:11.685689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:42:11.685689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:11.686228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 325/650] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:42:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:11.687489 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014b653-8202-4b4e-92ac-bbe3f93f9752 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:11.722089 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf89eef-d3ee-4a9b-9162-47603406c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:11.723008 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf89eef-d3ee-4a9b-9162-47603406c1aa None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:11.723480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf89eef-d3ee-4a9b-9162-47603406c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:11.723905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf89eef-d3ee-4a9b-9162-47603406c1aa None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:11.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf89eef-d3ee-4a9b-9162-47603406c1aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:11.725443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf89eef-d3ee-4a9b-9162-47603406c1aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:11.727003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf89eef-d3ee-4a9b-9162-47603406c1aa None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:11.740669 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 326/651] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:11.746715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf89eef-d3ee-4a9b-9162-47603406c1aa None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:11.776447 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:11.819158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014b653-8202-4b4e-92ac-bbe3f93f9752 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:11.829176 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:11.867066 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3046a-b2db-4f49-bb8f-24bd2491c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:11.867963 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3046a-b2db-4f49-bb8f-24bd2491c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:11.868243 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3046a-b2db-4f49-bb8f-24bd2491c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:11.868514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3046a-b2db-4f49-bb8f-24bd2491c0a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:11.869317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf89eef-d3ee-4a9b-9162-47603406c1aa None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:11.881918 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3046a-b2db-4f49-bb8f-24bd2491c0a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:11.883453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3046a-b2db-4f49-bb8f-24bd2491c0a5 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-d4d3046a-b2db-4f49-bb8f-24bd2491c0a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:11.904417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:11.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:11.906503 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:11.906503 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:11.906503 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:11.906503 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 326/652] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:11.906503 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3046a-b2db-4f49-bb8f-24bd2491c0a5 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:11.913714 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bd7a8-08b3-4220-a818-665df90cdd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:11.914385 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bd7a8-08b3-4220-a818-665df90cdd47 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:11.914667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bd7a8-08b3-4220-a818-665df90cdd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:11.914939 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bd7a8-08b3-4220-a818-665df90cdd47 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:11.915677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bd7a8-08b3-4220-a818-665df90cdd47 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:11.916323 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bd7a8-08b3-4220-a818-665df90cdd47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:11.917524 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bd7a8-08b3-4220-a818-665df90cdd47 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:11.936424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 327/653] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Sep 25 00:42:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:11.939483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bd7a8-08b3-4220-a818-665df90cdd47 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:12.019170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3046a-b2db-4f49-bb8f-24bd2491c0a5 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:12.047439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:12.052973 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bd7a8-08b3-4220-a818-665df90cdd47 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:12.058714 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6b4e2-ae3d-4c28-81df-79e792ce8d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:12.060389 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6b4e2-ae3d-4c28-81df-79e792ce8d89 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:12.061144 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6b4e2-ae3d-4c28-81df-79e792ce8d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:12.061807 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6b4e2-ae3d-4c28-81df-79e792ce8d89 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:12.075200 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6b4e2-ae3d-4c28-81df-79e792ce8d89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:12.076938 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6b4e2-ae3d-4c28-81df-79e792ce8d89 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:12.088399 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-a3e6b4e2-ae3d-4c28-81df-79e792ce8d89 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:12.090766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:12.092702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:12.092702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:12.092702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:12.092702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:12.092702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:12.092702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:12.092702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:12.092702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:12.092702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 25 00:42:12.092702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:12.095812 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 327/654] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:42:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:12.096771 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6b4e2-ae3d-4c28-81df-79e792ce8d89 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:12.102192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3fd01-9818-4475-a540-279efa24f478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:12.103041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3fd01-9818-4475-a540-279efa24f478 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:12.103423 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3fd01-9818-4475-a540-279efa24f478 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:12.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3fd01-9818-4475-a540-279efa24f478 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:12.104794 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3fd01-9818-4475-a540-279efa24f478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:12.105197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3fd01-9818-4475-a540-279efa24f478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:12.106706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3fd01-9818-4475-a540-279efa24f478 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:12.119787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 328/655] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:12.120959 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3fd01-9818-4475-a540-279efa24f478 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:12.215144 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6b4e2-ae3d-4c28-81df-79e792ce8d89 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:12.234337 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3fd01-9818-4475-a540-279efa24f478 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:12.260754 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408fe9a-4047-45f1-9790-3a713448ee09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:12.261740 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408fe9a-4047-45f1-9790-3a713448ee09 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:12.262732 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408fe9a-4047-45f1-9790-3a713448ee09 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:12.263248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408fe9a-4047-45f1-9790-3a713448ee09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:12.274811 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785eebc-ecba-42d1-89e7-b7dda1bf6421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:12.275663 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785eebc-ecba-42d1-89e7-b7dda1bf6421 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:12.275777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785eebc-ecba-42d1-89e7-b7dda1bf6421 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:12.276141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785eebc-ecba-42d1-89e7-b7dda1bf6421 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:12.276995 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785eebc-ecba-42d1-89e7-b7dda1bf6421 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:12.277376 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785eebc-ecba-42d1-89e7-b7dda1bf6421 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:12.278965 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785eebc-ecba-42d1-89e7-b7dda1bf6421 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:12.301078 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 329/656] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Sep 25 00:42:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:12.302075 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785eebc-ecba-42d1-89e7-b7dda1bf6421 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:12.325410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:12.341034 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408fe9a-4047-45f1-9790-3a713448ee09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:12.342493 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408fe9a-4047-45f1-9790-3a713448ee09 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:12.353111 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:12.410003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785eebc-ecba-42d1-89e7-b7dda1bf6421 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:12.446020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 328/657] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:42:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:42:12.447373 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408fe9a-4047-45f1-9790-3a713448ee09 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:12.453798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272d0c4-ce9b-4e0d-bf18-77a3a1d84970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:12.454436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272d0c4-ce9b-4e0d-bf18-77a3a1d84970 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:12.454715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272d0c4-ce9b-4e0d-bf18-77a3a1d84970 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:12.454998 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272d0c4-ce9b-4e0d-bf18-77a3a1d84970 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:12.462803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272d0c4-ce9b-4e0d-bf18-77a3a1d84970 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:12.464186 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272d0c4-ce9b-4e0d-bf18-77a3a1d84970 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-7272d0c4-ce9b-4e0d-bf18-77a3a1d84970 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:12.476426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:12.477583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:12.478521 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:12.478521 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:12.478521 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:12.478521 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:12.478521 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:12.478521 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:12.478521 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:12.478521 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:12.478521 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 00:42:12.478521 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:12.478521 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 330/658] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:12.479110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aef4b-5c6b-442e-8505-26d9b94d3677 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:12.479308 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aef4b-5c6b-442e-8505-26d9b94d3677 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:12.479503 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aef4b-5c6b-442e-8505-26d9b94d3677 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:12.484681 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 331/659] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:12.484681 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aef4b-5c6b-442e-8505-26d9b94d3677 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:12.544993 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:12.563208 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408fe9a-4047-45f1-9790-3a713448ee09 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:12.590429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aef4b-5c6b-442e-8505-26d9b94d3677 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:12.598011 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:12.600794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006e60c-4c30-4cc9-8206-133eaecc7a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:12.601649 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006e60c-4c30-4cc9-8206-133eaecc7a33 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:12.602107 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006e60c-4c30-4cc9-8206-133eaecc7a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:12.602560 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006e60c-4c30-4cc9-8206-133eaecc7a33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:12.631544 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca7de5-de83-4670-826f-7e86bf4f7baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:12.632435 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7de5-de83-4670-826f-7e86bf4f7baf None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:12.632911 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7de5-de83-4670-826f-7e86bf4f7baf None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:12.633185 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7de5-de83-4670-826f-7e86bf4f7baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:12.643420 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca7de5-de83-4670-826f-7e86bf4f7baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:12.644893 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca7de5-de83-4670-826f-7e86bf4f7baf None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-07ca7de5-de83-4670-826f-7e86bf4f7baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:12.659454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:12.665451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:12.666550 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:12.666550 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:12.666550 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:12.666550 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 332/660] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:12.666550 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca7de5-de83-4670-826f-7e86bf4f7baf None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:12.683729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006e60c-4c30-4cc9-8206-133eaecc7a33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:12.685916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006e60c-4c30-4cc9-8206-133eaecc7a33 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:12.768320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca7de5-de83-4670-826f-7e86bf4f7baf None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:12.775856 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:12.798951 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 329/661] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:42:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:42:12.800653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792582b-cbb6-4e76-a457-3edc4b5fb15e None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:12.801014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792582b-cbb6-4e76-a457-3edc4b5fb15e None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:12.801367 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792582b-cbb6-4e76-a457-3edc4b5fb15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:12.804367 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84612a-97fb-4da5-85c9-a470923f31c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84612a-97fb-4da5-85c9-a470923f31c7 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:12.805302 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84612a-97fb-4da5-85c9-a470923f31c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:12.805575 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84612a-97fb-4da5-85c9-a470923f31c7 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:12.806303 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84612a-97fb-4da5-85c9-a470923f31c7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:12.806611 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84612a-97fb-4da5-85c9-a470923f31c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:12.808030 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84612a-97fb-4da5-85c9-a470923f31c7 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:12.821359 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-a792582b-cbb6-4e76-a457-3edc4b5fb15e None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:12.823065 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-a792582b-cbb6-4e76-a457-3edc4b5fb15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:12.828711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 333/662] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Sep 25 00:42:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:12.829809 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84612a-97fb-4da5-85c9-a470923f31c7 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:12.849956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:12.900760 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 330/663] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:12.900760 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792582b-cbb6-4e76-a457-3edc4b5fb15e None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:12.950641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84612a-97fb-4da5-85c9-a470923f31c7 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:12.991714 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea2959-d29d-4755-bb83-acc325ba687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:12.992319 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2959-d29d-4755-bb83-acc325ba687e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:12.992630 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2959-d29d-4755-bb83-acc325ba687e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:12.992908 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2959-d29d-4755-bb83-acc325ba687e None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:12.993548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea2959-d29d-4755-bb83-acc325ba687e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:12.993847 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea2959-d29d-4755-bb83-acc325ba687e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:12.995214 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea2959-d29d-4755-bb83-acc325ba687e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:13.008838 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 334/664] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:13.009802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea2959-d29d-4755-bb83-acc325ba687e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:13.021419 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792582b-cbb6-4e76-a457-3edc4b5fb15e None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:13.042298 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:13.064413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecff8f-a014-4319-933a-b18dc12ad28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:13.065015 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecff8f-a014-4319-933a-b18dc12ad28f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:13.065297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecff8f-a014-4319-933a-b18dc12ad28f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:13.065572 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecff8f-a014-4319-933a-b18dc12ad28f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:13.078504 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecff8f-a014-4319-933a-b18dc12ad28f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:13.079958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecff8f-a014-4319-933a-b18dc12ad28f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:13.089469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-17ecff8f-a014-4319-933a-b18dc12ad28f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:13.099531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:13.100471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:13.101402 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:13.101402 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:13.101402 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:13.104717 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 331/665] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:13.107235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecff8f-a014-4319-933a-b18dc12ad28f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:13.118998 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea2959-d29d-4755-bb83-acc325ba687e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:13.154189 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b7c33-266e-4e52-b39f-73895baf15ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:13.154798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b7c33-266e-4e52-b39f-73895baf15ef None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:13.155076 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b7c33-266e-4e52-b39f-73895baf15ef None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:13.155350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b7c33-266e-4e52-b39f-73895baf15ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:13.223010 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecff8f-a014-4319-933a-b18dc12ad28f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:13.232494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b7c33-266e-4e52-b39f-73895baf15ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:13.234322 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b7c33-266e-4e52-b39f-73895baf15ef None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:13.259276 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cace5a-b6f2-4d3f-8da3-b47bb80d02af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:13.260025 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cace5a-b6f2-4d3f-8da3-b47bb80d02af None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:13.260309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cace5a-b6f2-4d3f-8da3-b47bb80d02af None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:13.260609 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cace5a-b6f2-4d3f-8da3-b47bb80d02af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:13.268226 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cace5a-b6f2-4d3f-8da3-b47bb80d02af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:13.269698 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cace5a-b6f2-4d3f-8da3-b47bb80d02af None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-42cace5a-b6f2-4d3f-8da3-b47bb80d02af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:13.282667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:13.283587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:13.284497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:13.284497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:13.284497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:13.284497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:13.284497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:13.284497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:13.284497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:13.284497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:13.288510 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 332/666] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:13.289355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cace5a-b6f2-4d3f-8da3-b47bb80d02af None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:13.309712 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:13.320660 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:13.336094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 335/667] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:42:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:42:13.336992 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b7c33-266e-4e52-b39f-73895baf15ef None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:13.405879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cace5a-b6f2-4d3f-8da3-b47bb80d02af None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:13.438860 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b7c33-266e-4e52-b39f-73895baf15ef None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:13.442100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852ed8b-5f47-49a6-9c80-706cc0a0200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:13.442956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852ed8b-5f47-49a6-9c80-706cc0a0200a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:13.443456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852ed8b-5f47-49a6-9c80-706cc0a0200a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:13.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852ed8b-5f47-49a6-9c80-706cc0a0200a None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:13.444801 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852ed8b-5f47-49a6-9c80-706cc0a0200a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:13.445317 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852ed8b-5f47-49a6-9c80-706cc0a0200a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:13.447250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852ed8b-5f47-49a6-9c80-706cc0a0200a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:13.461095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 333/668] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:13.462255 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852ed8b-5f47-49a6-9c80-706cc0a0200a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:13.481078 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169581ff-e4cb-4aea-aa1d-3fd22484f2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:13.481954 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169581ff-e4cb-4aea-aa1d-3fd22484f2df None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:13.482231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169581ff-e4cb-4aea-aa1d-3fd22484f2df None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:13.482882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169581ff-e4cb-4aea-aa1d-3fd22484f2df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:13.495512 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169581ff-e4cb-4aea-aa1d-3fd22484f2df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-169581ff-e4cb-4aea-aa1d-3fd22484f2df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:13.500477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:13.501444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:13.502256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:13.502256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:13.502256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:13.502256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:13.502256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:13.502256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:13.502256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:13.502256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:13.502256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:13.502256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:13.502256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:13.502256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:13.506341 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 336/669] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:13.507192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169581ff-e4cb-4aea-aa1d-3fd22484f2df None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:13.544180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:13.557168 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:13.572791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852ed8b-5f47-49a6-9c80-706cc0a0200a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:13.607778 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8a765-9951-444a-8192-1365eaf9bccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:13.608383 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8a765-9951-444a-8192-1365eaf9bccc None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:13.608693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8a765-9951-444a-8192-1365eaf9bccc None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:13.609224 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8a765-9951-444a-8192-1365eaf9bccc None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:13.609649 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8a765-9951-444a-8192-1365eaf9bccc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:13.609952 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8a765-9951-444a-8192-1365eaf9bccc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:13.611478 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8a765-9951-444a-8192-1365eaf9bccc None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:13.615825 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169581ff-e4cb-4aea-aa1d-3fd22484f2df None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:13.628205 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 334/670] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:13.628205 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8a765-9951-444a-8192-1365eaf9bccc None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:13.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75632e8c-c12f-46c1-8df3-d07d0b0b556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:13.662386 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75632e8c-c12f-46c1-8df3-d07d0b0b556d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:13.662662 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75632e8c-c12f-46c1-8df3-d07d0b0b556d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:13.662932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75632e8c-c12f-46c1-8df3-d07d0b0b556d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:13.674726 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75632e8c-c12f-46c1-8df3-d07d0b0b556d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:13.676471 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75632e8c-c12f-46c1-8df3-d07d0b0b556d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-75632e8c-c12f-46c1-8df3-d07d0b0b556d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:13.691748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:13.693045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:13.693928 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:13.693928 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:13.693928 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:13.693928 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 337/671] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:13.693928 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75632e8c-c12f-46c1-8df3-d07d0b0b556d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:13.737426 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8a765-9951-444a-8192-1365eaf9bccc None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:13.776480 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe53d80-14cf-4e61-b638-e20b48b62d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:13.777188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe53d80-14cf-4e61-b638-e20b48b62d51 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:13.777469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe53d80-14cf-4e61-b638-e20b48b62d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:13.777743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe53d80-14cf-4e61-b638-e20b48b62d51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:13.786963 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe53d80-14cf-4e61-b638-e20b48b62d51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:13.788651 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe53d80-14cf-4e61-b638-e20b48b62d51 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:13.796061 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-ebe53d80-14cf-4e61-b638-e20b48b62d51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:13.801608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:13.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:13.803466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:13.803466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:13.803466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:13.803466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:13.803466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:13.803466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:13.803466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:13.803466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:13.803466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 335/672] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:13.804676 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe53d80-14cf-4e61-b638-e20b48b62d51 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:13.816565 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:13.819056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75632e8c-c12f-46c1-8df3-d07d0b0b556d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:13.856984 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102385b-0615-49f1-b816-248fbbcf07d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:13.857909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102385b-0615-49f1-b816-248fbbcf07d8 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:13.858448 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102385b-0615-49f1-b816-248fbbcf07d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:13.858727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102385b-0615-49f1-b816-248fbbcf07d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:13.859389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102385b-0615-49f1-b816-248fbbcf07d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:13.859696 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102385b-0615-49f1-b816-248fbbcf07d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:13.861296 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102385b-0615-49f1-b816-248fbbcf07d8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:13.874979 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 338/673] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:42:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:13.875627 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102385b-0615-49f1-b816-248fbbcf07d8 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:13.914057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe53d80-14cf-4e61-b638-e20b48b62d51 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:13.947379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8854b6-f2a0-4f88-bf4e-957338dc903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:13.947975 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8854b6-f2a0-4f88-bf4e-957338dc903c None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:13.948252 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8854b6-f2a0-4f88-bf4e-957338dc903c None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:13.948532 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8854b6-f2a0-4f88-bf4e-957338dc903c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:13.949318 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8854b6-f2a0-4f88-bf4e-957338dc903c None admin] RBAC: Adding query filter params (role.id=e190761ca5494052a96426d0bd344261, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=41cd0c4bf9734339ba9e8f2dabb9a0ad) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:13.949625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8854b6-f2a0-4f88-bf4e-957338dc903c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:13.951342 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8854b6-f2a0-4f88-bf4e-957338dc903c None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:13.956824 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 336/674] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:13 2022] GET /identity/v3/role_assignments?user.id=41cd0c4bf9734339ba9e8f2dabb9a0ad&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=e190761ca5494052a96426d0bd344261 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:13.957595 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8854b6-f2a0-4f88-bf4e-957338dc903c None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:13.976693 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102385b-0615-49f1-b816-248fbbcf07d8 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:14.014470 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36d6b2-bd5a-44ac-91e6-22f10efdb579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:14.015098 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36d6b2-bd5a-44ac-91e6-22f10efdb579 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:14.015381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36d6b2-bd5a-44ac-91e6-22f10efdb579 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:14.015649 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36d6b2-bd5a-44ac-91e6-22f10efdb579 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:14.016309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36d6b2-bd5a-44ac-91e6-22f10efdb579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:14.016641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36d6b2-bd5a-44ac-91e6-22f10efdb579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:14.018064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36d6b2-bd5a-44ac-91e6-22f10efdb579 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:14.035897 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 339/675] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:14.035897 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36d6b2-bd5a-44ac-91e6-22f10efdb579 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:14.046904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:14.050294 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:14.090288 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8854b6-f2a0-4f88-bf4e-957338dc903c None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:14.127882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edba7a4-d96c-4c2c-8ac5-25bceff41797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:14.128497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edba7a4-d96c-4c2c-8ac5-25bceff41797 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:14.128807 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edba7a4-d96c-4c2c-8ac5-25bceff41797 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:14.129080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edba7a4-d96c-4c2c-8ac5-25bceff41797 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:14.129780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edba7a4-d96c-4c2c-8ac5-25bceff41797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:14.130089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edba7a4-d96c-4c2c-8ac5-25bceff41797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:14.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edba7a4-d96c-4c2c-8ac5-25bceff41797 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:14.153157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 337/676] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:14.154506 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d481ccf-33c2-4076-8d29-4323e7fea47e None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:14.154506 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d481ccf-33c2-4076-8d29-4323e7fea47e None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:14.154891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d481ccf-33c2-4076-8d29-4323e7fea47e None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:14.156229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 338/677] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:14.157730 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d481ccf-33c2-4076-8d29-4323e7fea47e None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:14.163216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36d6b2-bd5a-44ac-91e6-22f10efdb579 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:14.201253 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab52a3-057c-4912-8880-7b9ee3056182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:14.201894 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab52a3-057c-4912-8880-7b9ee3056182 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:14.202176 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab52a3-057c-4912-8880-7b9ee3056182 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:14.202454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab52a3-057c-4912-8880-7b9ee3056182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:14.212620 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab52a3-057c-4912-8880-7b9ee3056182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:14.214136 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab52a3-057c-4912-8880-7b9ee3056182 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-8dab52a3-057c-4912-8880-7b9ee3056182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:14.229338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:14.230278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:14.231700 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:14.231700 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:14.231700 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:14.231700 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 340/678] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:14.231932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab52a3-057c-4912-8880-7b9ee3056182 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:14.276233 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d481ccf-33c2-4076-8d29-4323e7fea47e None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:14.300833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:14.309503 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:14.315607 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4c5d8-ad1c-4e3f-8040-fb6cd9567123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:14.316373 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4c5d8-ad1c-4e3f-8040-fb6cd9567123 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:14.316684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4c5d8-ad1c-4e3f-8040-fb6cd9567123 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:14.316961 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4c5d8-ad1c-4e3f-8040-fb6cd9567123 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:14.324894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4c5d8-ad1c-4e3f-8040-fb6cd9567123 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:14.326341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4c5d8-ad1c-4e3f-8040-fb6cd9567123 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-23d4c5d8-ad1c-4e3f-8040-fb6cd9567123 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:14.337494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:14.338366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:14.339242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:14.339242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:14.339242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:14.339242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:14.339242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:14.339242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:14.339242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:14.339242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:14.343870 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 339/679] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:14.344900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29dac6-2152-455b-9eda-d59854458ced None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:14.345186 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29dac6-2152-455b-9eda-d59854458ced None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:14.345462 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29dac6-2152-455b-9eda-d59854458ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:14.346205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab52a3-057c-4912-8880-7b9ee3056182 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:14.363353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-bf29dac6-2152-455b-9eda-d59854458ced None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:14.364571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-bf29dac6-2152-455b-9eda-d59854458ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:14.386426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ad259-6dbb-4dcc-b95b-f87224326d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:14.387056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ad259-6dbb-4dcc-b95b-f87224326d8a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:14.387346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ad259-6dbb-4dcc-b95b-f87224326d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:14.387604 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ad259-6dbb-4dcc-b95b-f87224326d8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:14.388326 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ad259-6dbb-4dcc-b95b-f87224326d8a None admin] RBAC: Adding query filter params (role.id=e190761ca5494052a96426d0bd344261, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=94b2d0afc3294d75897dda3dd8f78aed) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:14.388663 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ad259-6dbb-4dcc-b95b-f87224326d8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:14.390103 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ad259-6dbb-4dcc-b95b-f87224326d8a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:14.396054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 341/680] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:14 2022] GET /identity/v3/role_assignments?user.id=94b2d0afc3294d75897dda3dd8f78aed&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=e190761ca5494052a96426d0bd344261 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:14.396706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ad259-6dbb-4dcc-b95b-f87224326d8a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:14.449240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 340/681] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:14.451098 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29dac6-2152-455b-9eda-d59854458ced None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:14.520675 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ad259-6dbb-4dcc-b95b-f87224326d8a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:14.551287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:14.561414 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807fe10-16de-4236-b95b-e96b4cfe38f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:14.562831 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fe10-16de-4236-b95b-e96b4cfe38f4 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:14.563364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fe10-16de-4236-b95b-e96b4cfe38f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:14.564042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fe10-16de-4236-b95b-e96b4cfe38f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:14.565087 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807fe10-16de-4236-b95b-e96b4cfe38f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:14.565603 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807fe10-16de-4236-b95b-e96b4cfe38f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:14.567202 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807fe10-16de-4236-b95b-e96b4cfe38f4 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:14.582036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 342/682] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:14.587856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807fe10-16de-4236-b95b-e96b4cfe38f4 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:14.675102 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29dac6-2152-455b-9eda-d59854458ced None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:14.704177 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807fe10-16de-4236-b95b-e96b4cfe38f4 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:14.705520 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:14.721491 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1117089-9e8b-421d-8788-3dd6e3178203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:14.722494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1117089-9e8b-421d-8788-3dd6e3178203 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:14.722785 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1117089-9e8b-421d-8788-3dd6e3178203 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:14.723061 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1117089-9e8b-421d-8788-3dd6e3178203 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:14.724623 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1117089-9e8b-421d-8788-3dd6e3178203 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:14.725331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1117089-9e8b-421d-8788-3dd6e3178203 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:14.726782 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1117089-9e8b-421d-8788-3dd6e3178203 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:14.741349 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 341/683] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:14.746754 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1117089-9e8b-421d-8788-3dd6e3178203 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:14.756247 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f150bd4-75a8-44f1-9413-2aabe4665cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:14.757775 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f150bd4-75a8-44f1-9413-2aabe4665cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:14.758246 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f150bd4-75a8-44f1-9413-2aabe4665cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:14.758721 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f150bd4-75a8-44f1-9413-2aabe4665cc8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:14.771277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f150bd4-75a8-44f1-9413-2aabe4665cc8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:14.773637 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f150bd4-75a8-44f1-9413-2aabe4665cc8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-0f150bd4-75a8-44f1-9413-2aabe4665cc8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:14.792182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:14.793234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:14.794180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:14.794180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:14.794180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:14.794180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:14.794180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:14.794180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:14.794180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:14.794180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:14.794180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:42:14.794180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:14.797604 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 343/684] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:42:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:14.798574 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f150bd4-75a8-44f1-9413-2aabe4665cc8 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:14.852189 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:14.884882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1117089-9e8b-421d-8788-3dd6e3178203 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:14.917132 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f150bd4-75a8-44f1-9413-2aabe4665cc8 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:14.931964 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce63a51-8a9c-4923-afcd-0f46af48e254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:14.933402 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce63a51-8a9c-4923-afcd-0f46af48e254 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:14.933931 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce63a51-8a9c-4923-afcd-0f46af48e254 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:14.934421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce63a51-8a9c-4923-afcd-0f46af48e254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:14.939419 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce63a51-8a9c-4923-afcd-0f46af48e254 None admin] RBAC: Adding query filter params (role.id=e190761ca5494052a96426d0bd344261, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=42a2f85512e648698fdc7ab7cac75752) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:14.941298 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce63a51-8a9c-4923-afcd-0f46af48e254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:14.944265 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce63a51-8a9c-4923-afcd-0f46af48e254 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:14.955183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 342/685] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:14 2022] GET /identity/v3/role_assignments?user.id=42a2f85512e648698fdc7ab7cac75752&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=e190761ca5494052a96426d0bd344261 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:14.955969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce63a51-8a9c-4923-afcd-0f46af48e254 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:14.972875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30772a8-fbe0-4636-9f18-bac68a700ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:14.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30772a8-fbe0-4636-9f18-bac68a700ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:14.975609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30772a8-fbe0-4636-9f18-bac68a700ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:14.975823 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30772a8-fbe0-4636-9f18-bac68a700ad0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:15.001916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30772a8-fbe0-4636-9f18-bac68a700ad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-f30772a8-fbe0-4636-9f18-bac68a700ad0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:15.008301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:15.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:15.010182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:15.010182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:15.010182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:15.010182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:15.010182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:15.010182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:15.010182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:15.010182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:15.010182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:15.010182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:15.010182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:42:15.010182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:15.010182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 344/686] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:42:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:15.017749 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30772a8-fbe0-4636-9f18-bac68a700ad0 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:15.040058 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:15.123059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce63a51-8a9c-4923-afcd-0f46af48e254 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:15.171073 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfcbe0-8184-4e9d-bc0d-22a332033a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:15.173036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfcbe0-8184-4e9d-bc0d-22a332033a1b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:15.174916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfcbe0-8184-4e9d-bc0d-22a332033a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:15.175672 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfcbe0-8184-4e9d-bc0d-22a332033a1b None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:15.177274 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfcbe0-8184-4e9d-bc0d-22a332033a1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:15.178337 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfcbe0-8184-4e9d-bc0d-22a332033a1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:15.180937 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfcbe0-8184-4e9d-bc0d-22a332033a1b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:15.215900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 343/687] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Sep 25 00:42:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:15.221682 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfcbe0-8184-4e9d-bc0d-22a332033a1b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:15.233510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30772a8-fbe0-4636-9f18-bac68a700ad0 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:15.240464 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:15.276877 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba626b4c-b331-4952-a11e-ee7c89919422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:15.277598 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba626b4c-b331-4952-a11e-ee7c89919422 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:15.277882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba626b4c-b331-4952-a11e-ee7c89919422 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:15.278159 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba626b4c-b331-4952-a11e-ee7c89919422 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:15.278838 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba626b4c-b331-4952-a11e-ee7c89919422 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:15.279146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba626b4c-b331-4952-a11e-ee7c89919422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:15.284733 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba626b4c-b331-4952-a11e-ee7c89919422 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:15.299169 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 345/688] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:42:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:15.310249 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba626b4c-b331-4952-a11e-ee7c89919422 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:15.345338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfcbe0-8184-4e9d-bc0d-22a332033a1b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:15.351537 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:15.415056 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1284cc-b900-4dca-831f-c5b7720fc60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:15.415669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1284cc-b900-4dca-831f-c5b7720fc60f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:15.415945 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1284cc-b900-4dca-831f-c5b7720fc60f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:15.416215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1284cc-b900-4dca-831f-c5b7720fc60f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:15.505216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba626b4c-b331-4952-a11e-ee7c89919422 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:15.543575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1284cc-b900-4dca-831f-c5b7720fc60f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:15.545261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1284cc-b900-4dca-831f-c5b7720fc60f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:15.569126 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bec596-2b90-4ab9-bbd8-32f4ca6d5725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:15.569762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec596-2b90-4ab9-bbd8-32f4ca6d5725 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:15.570090 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec596-2b90-4ab9-bbd8-32f4ca6d5725 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:15.570366 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec596-2b90-4ab9-bbd8-32f4ca6d5725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:15.590045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bec596-2b90-4ab9-bbd8-32f4ca6d5725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:15.591499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bec596-2b90-4ab9-bbd8-32f4ca6d5725 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-51bec596-2b90-4ab9-bbd8-32f4ca6d5725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:15.626342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:15.627370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:15.628258 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:15.628258 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:15.628258 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:15.628258 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 346/689] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:15.633494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bec596-2b90-4ab9-bbd8-32f4ca6d5725 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:15.684931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:15.744986 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 344/690] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:42:15.746726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1284cc-b900-4dca-831f-c5b7720fc60f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:15.753791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:15.828232 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bec596-2b90-4ab9-bbd8-32f4ca6d5725 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:15.875091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ab389-9458-4013-a0de-1f9a6f763b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:15.877097 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ab389-9458-4013-a0de-1f9a6f763b2a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:15.879094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ab389-9458-4013-a0de-1f9a6f763b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:15.879605 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ab389-9458-4013-a0de-1f9a6f763b2a None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:15.880449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ab389-9458-4013-a0de-1f9a6f763b2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:15.881841 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ab389-9458-4013-a0de-1f9a6f763b2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:15.883421 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ab389-9458-4013-a0de-1f9a6f763b2a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:15.914247 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 347/691] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:15.920383 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ab389-9458-4013-a0de-1f9a6f763b2a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:15.940308 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1284cc-b900-4dca-831f-c5b7720fc60f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:15.994366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fce01-fc58-4b1d-b974-76d4d31b319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:15.995017 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fce01-fc58-4b1d-b974-76d4d31b319b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:15.995298 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fce01-fc58-4b1d-b974-76d4d31b319b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:15.995737 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fce01-fc58-4b1d-b974-76d4d31b319b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:16.017991 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fce01-fc58-4b1d-b974-76d4d31b319b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:16.019472 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fce01-fc58-4b1d-b974-76d4d31b319b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-d77fce01-fc58-4b1d-b974-76d4d31b319b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:16.053370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:16.054460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:16.055355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:16.055355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:16.055355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:16.059488 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 345/692] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:16.062137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fce01-fc58-4b1d-b974-76d4d31b319b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:16.068929 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:16.105222 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ab389-9458-4013-a0de-1f9a6f763b2a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:16.146228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28c3f8-b6a1-41f2-afb7-119583044f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:16.146866 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c3f8-b6a1-41f2-afb7-119583044f1a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:16.147149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c3f8-b6a1-41f2-afb7-119583044f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:16.147425 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c3f8-b6a1-41f2-afb7-119583044f1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:16.156634 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28c3f8-b6a1-41f2-afb7-119583044f1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:16.158263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28c3f8-b6a1-41f2-afb7-119583044f1a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-7b28c3f8-b6a1-41f2-afb7-119583044f1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:16.171753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:16.172727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:16.173679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:16.173679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:16.173679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:16.173679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:16.173679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:16.173679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:16.173679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:16.173679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:16.173679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:42:16.173679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:16.177317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 348/693] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Sep 25 00:42:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:16.179791 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28c3f8-b6a1-41f2-afb7-119583044f1a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:16.189846 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:16.294139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28c3f8-b6a1-41f2-afb7-119583044f1a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:16.311186 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fce01-fc58-4b1d-b974-76d4d31b319b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:16.333878 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca876f-5b83-4e3a-ae0a-12428d4b73f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:16.334732 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca876f-5b83-4e3a-ae0a-12428d4b73f1 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:16.335307 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca876f-5b83-4e3a-ae0a-12428d4b73f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:16.335874 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca876f-5b83-4e3a-ae0a-12428d4b73f1 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:16.336801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca876f-5b83-4e3a-ae0a-12428d4b73f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:16.337259 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca876f-5b83-4e3a-ae0a-12428d4b73f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:16.339116 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca876f-5b83-4e3a-ae0a-12428d4b73f1 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:16.352925 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:16.364920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 349/694] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Sep 25 00:42:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:16.369841 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca876f-5b83-4e3a-ae0a-12428d4b73f1 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:16.430351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610369ab-d336-4f86-8c4d-a7e903ddc161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:16.431071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610369ab-d336-4f86-8c4d-a7e903ddc161 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:16.431356 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610369ab-d336-4f86-8c4d-a7e903ddc161 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:16.431637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610369ab-d336-4f86-8c4d-a7e903ddc161 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:16.432301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610369ab-d336-4f86-8c4d-a7e903ddc161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:16.432633 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610369ab-d336-4f86-8c4d-a7e903ddc161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:16.434066 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610369ab-d336-4f86-8c4d-a7e903ddc161 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:16.470833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 346/695] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:16.481604 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610369ab-d336-4f86-8c4d-a7e903ddc161 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:16.485833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca876f-5b83-4e3a-ae0a-12428d4b73f1 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:16.525113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbc6f9-2347-4c55-a55f-f2945a11d2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:16.526116 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbc6f9-2347-4c55-a55f-f2945a11d2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:16.526593 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbc6f9-2347-4c55-a55f-f2945a11d2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:16.527075 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbc6f9-2347-4c55-a55f-f2945a11d2a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:16.605891 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbc6f9-2347-4c55-a55f-f2945a11d2a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:16.607713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbc6f9-2347-4c55-a55f-f2945a11d2a7 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:16.621755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:16.640685 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610369ab-d336-4f86-8c4d-a7e903ddc161 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:16.664192 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:16.684454 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c9f08-7f92-44bc-88fa-835e660fa002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:16.685560 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c9f08-7f92-44bc-88fa-835e660fa002 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:16.686037 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c9f08-7f92-44bc-88fa-835e660fa002 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:16.686528 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c9f08-7f92-44bc-88fa-835e660fa002 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:16.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c9f08-7f92-44bc-88fa-835e660fa002 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:16.695529 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c9f08-7f92-44bc-88fa-835e660fa002 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-d44c9f08-7f92-44bc-88fa-835e660fa002 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:16.707935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:16.708847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:16.709738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:16.709738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:16.709738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:16.709738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:16.709738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:16.709738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:16.709738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:16.709738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:16.716395 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 347/696] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:16.717865 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e9fbb-af84-4b14-9d9b-ad9bf7801b7b None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:16.718343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e9fbb-af84-4b14-9d9b-ad9bf7801b7b None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:16.718810 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e9fbb-af84-4b14-9d9b-ad9bf7801b7b None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:16.720470 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 348/697] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:16.725381 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e9fbb-af84-4b14-9d9b-ad9bf7801b7b None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:16.726814 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 350/698] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:42:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:42:16.728115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6a92f-c1b5-410a-9e70-6c40679a5708 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:16.728400 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6a92f-c1b5-410a-9e70-6c40679a5708 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:16.728704 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6a92f-c1b5-410a-9e70-6c40679a5708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:16.746833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-ada6a92f-c1b5-410a-9e70-6c40679a5708 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:16.748021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-ada6a92f-c1b5-410a-9e70-6c40679a5708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:16.833514 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 351/699] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:16.833514 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6a92f-c1b5-410a-9e70-6c40679a5708 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:16.851661 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e9fbb-af84-4b14-9d9b-ad9bf7801b7b None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:16.860276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:16.890106 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cead5-015d-401e-8c11-c71f5c0bd8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:16.891110 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cead5-015d-401e-8c11-c71f5c0bd8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:16.891588 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cead5-015d-401e-8c11-c71f5c0bd8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:16.892076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cead5-015d-401e-8c11-c71f5c0bd8d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:16.892992 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cead5-015d-401e-8c11-c71f5c0bd8d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:16.893493 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cead5-015d-401e-8c11-c71f5c0bd8d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:16.895197 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cead5-015d-401e-8c11-c71f5c0bd8d7 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:16.909045 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 349/700] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:16.915145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cead5-015d-401e-8c11-c71f5c0bd8d7 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:16.953054 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:16.979874 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6a92f-c1b5-410a-9e70-6c40679a5708 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:17.032453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cead5-015d-401e-8c11-c71f5c0bd8d7 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:17.049811 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c790e-cb74-4555-9892-524cbcee037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:17.050452 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c790e-cb74-4555-9892-524cbcee037f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:17.050730 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c790e-cb74-4555-9892-524cbcee037f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:17.051004 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c790e-cb74-4555-9892-524cbcee037f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:17.062478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c790e-cb74-4555-9892-524cbcee037f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:17.064018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c790e-cb74-4555-9892-524cbcee037f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:17.071543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efb366-9c25-4fb9-b59c-dd7e0dc395ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:17.072444 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efb366-9c25-4fb9-b59c-dd7e0dc395ad None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:17.072923 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efb366-9c25-4fb9-b59c-dd7e0dc395ad None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:17.073371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efb366-9c25-4fb9-b59c-dd7e0dc395ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:17.074375 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efb366-9c25-4fb9-b59c-dd7e0dc395ad None admin] RBAC: Adding query filter params (role.id=e190761ca5494052a96426d0bd344261, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=38f2083bb2a54a9ca22546b5e7aaf032) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:17.074873 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efb366-9c25-4fb9-b59c-dd7e0dc395ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:17.076457 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efb366-9c25-4fb9-b59c-dd7e0dc395ad None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-e20c790e-cb74-4555-9892-524cbcee037f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:17.080859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:17.081763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:17.082703 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:17.082703 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:17.082703 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:17.082703 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 352/701] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:17.084014 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679afe6c-b531-4ab4-92e7-8adbb13fd8a5 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:17.084357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679afe6c-b531-4ab4-92e7-8adbb13fd8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:17.084757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679afe6c-b531-4ab4-92e7-8adbb13fd8a5 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:17.086032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 350/702] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:16 2022] GET /identity/v3/role_assignments?user.id=38f2083bb2a54a9ca22546b5e7aaf032&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=e190761ca5494052a96426d0bd344261 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:17.091213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 353/703] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:17.092958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75947794-9f10-4f4f-8fb4-4ff8a75d7e6e None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:17.093403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75947794-9f10-4f4f-8fb4-4ff8a75d7e6e None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:17.093829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75947794-9f10-4f4f-8fb4-4ff8a75d7e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:17.097868 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679afe6c-b531-4ab4-92e7-8adbb13fd8a5 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:17.116085 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-75947794-9f10-4f4f-8fb4-4ff8a75d7e6e None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:17.118301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-75947794-9f10-4f4f-8fb4-4ff8a75d7e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:17.217293 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 351/704] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:17.217891 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:17.217975 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75947794-9f10-4f4f-8fb4-4ff8a75d7e6e None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:17.261798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679afe6c-b531-4ab4-92e7-8adbb13fd8a5 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:17.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:17.323929 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19529c-4165-4e8a-88d2-b16aaa5d4361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:17.324746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19529c-4165-4e8a-88d2-b16aaa5d4361 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:17.325125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19529c-4165-4e8a-88d2-b16aaa5d4361 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:17.325600 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19529c-4165-4e8a-88d2-b16aaa5d4361 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:17.326722 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19529c-4165-4e8a-88d2-b16aaa5d4361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:17.327097 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19529c-4165-4e8a-88d2-b16aaa5d4361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:17.329056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19529c-4165-4e8a-88d2-b16aaa5d4361 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:17.358700 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 354/705] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:17.366295 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19529c-4165-4e8a-88d2-b16aaa5d4361 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:17.384372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75947794-9f10-4f4f-8fb4-4ff8a75d7e6e None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:17.427693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277f6b1-71b6-46c6-9909-540711cdd068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:17.428331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277f6b1-71b6-46c6-9909-540711cdd068 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:17.428644 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277f6b1-71b6-46c6-9909-540711cdd068 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:17.428920 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277f6b1-71b6-46c6-9909-540711cdd068 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:17.429509 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277f6b1-71b6-46c6-9909-540711cdd068 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:17.430891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277f6b1-71b6-46c6-9909-540711cdd068 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-4277f6b1-71b6-46c6-9909-540711cdd068 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:17.443935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:17.445239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:17.446843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 352/706] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Sep 25 00:42:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:17.451045 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277f6b1-71b6-46c6-9909-540711cdd068 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:17.514631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19529c-4165-4e8a-88d2-b16aaa5d4361 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:17.553909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16fa9b-ecc8-4859-9c5d-0df23ba0b95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:17.554800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16fa9b-ecc8-4859-9c5d-0df23ba0b95c None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:17.554800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16fa9b-ecc8-4859-9c5d-0df23ba0b95c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:17.555124 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16fa9b-ecc8-4859-9c5d-0df23ba0b95c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:17.562130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16fa9b-ecc8-4859-9c5d-0df23ba0b95c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:17.563543 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16fa9b-ecc8-4859-9c5d-0df23ba0b95c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:17.566400 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:17.575452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-8d16fa9b-ecc8-4859-9c5d-0df23ba0b95c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:17.578152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:17.579022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:17.580351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:17.580351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:17.580351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:17.580351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:17.580351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:17.580351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:17.580351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:17.580351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:17.580351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 355/707] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:17.581594 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5550c-e527-4c50-a02d-bb61c02e9eb1 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:17.581895 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5550c-e527-4c50-a02d-bb61c02e9eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:17.582163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5550c-e527-4c50-a02d-bb61c02e9eb1 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:17.583536 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 356/708] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:17.587651 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5550c-e527-4c50-a02d-bb61c02e9eb1 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:17.587772 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277f6b1-71b6-46c6-9909-540711cdd068 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:17.624468 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b264a-2471-420a-bffa-9ebb88be801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:17.625125 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b264a-2471-420a-bffa-9ebb88be801c None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:17.625406 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b264a-2471-420a-bffa-9ebb88be801c None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:17.625678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b264a-2471-420a-bffa-9ebb88be801c None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:17.626322 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b264a-2471-420a-bffa-9ebb88be801c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:17.626639 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b264a-2471-420a-bffa-9ebb88be801c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:17.628010 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b264a-2471-420a-bffa-9ebb88be801c None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:17.632590 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 353/709] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Sep 25 00:42:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:17.633383 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b264a-2471-420a-bffa-9ebb88be801c None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:17.713436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5550c-e527-4c50-a02d-bb61c02e9eb1 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:17.750585 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e6345-0a43-48c9-8a41-10d444cc40eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:17.751211 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6345-0a43-48c9-8a41-10d444cc40eb None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:17.751317 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b264a-2471-420a-bffa-9ebb88be801c None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:17.751480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6345-0a43-48c9-8a41-10d444cc40eb None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:17.751749 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6345-0a43-48c9-8a41-10d444cc40eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:17.763801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e6345-0a43-48c9-8a41-10d444cc40eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:17.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e6345-0a43-48c9-8a41-10d444cc40eb None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-4e9e6345-0a43-48c9-8a41-10d444cc40eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:17.785436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:17.786517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:17.787425 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:17.787425 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:17.787425 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:17.787425 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 357/710] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:17.788232 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121a2c4-44e5-44e2-9d5d-a61a7af8a392 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:17.788503 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121a2c4-44e5-44e2-9d5d-a61a7af8a392 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:17.788874 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121a2c4-44e5-44e2-9d5d-a61a7af8a392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:17.799713 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5a00b-7914-4be4-9181-9c31165ac9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:17.800711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5a00b-7914-4be4-9181-9c31165ac9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:17.801213 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5a00b-7914-4be4-9181-9c31165ac9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:17.801691 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5a00b-7914-4be4-9181-9c31165ac9c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:17.802588 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5a00b-7914-4be4-9181-9c31165ac9c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:17.803105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5a00b-7914-4be4-9181-9c31165ac9c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:17.805439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5a00b-7914-4be4-9181-9c31165ac9c0 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:17.810182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-f121a2c4-44e5-44e2-9d5d-a61a7af8a392 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:17.818206 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-f121a2c4-44e5-44e2-9d5d-a61a7af8a392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:17.819789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 354/711] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:17.820887 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5a00b-7914-4be4-9181-9c31165ac9c0 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:17.847192 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:17.890361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:17.924631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 358/712] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:17.924631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121a2c4-44e5-44e2-9d5d-a61a7af8a392 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:17.960755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5a00b-7914-4be4-9181-9c31165ac9c0 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:18.029961 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31c5b5-58be-49c6-9fb5-5efc7e8ee49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:18.030648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31c5b5-58be-49c6-9fb5-5efc7e8ee49d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:18.030926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31c5b5-58be-49c6-9fb5-5efc7e8ee49d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:18.031193 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31c5b5-58be-49c6-9fb5-5efc7e8ee49d None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:18.031827 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31c5b5-58be-49c6-9fb5-5efc7e8ee49d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:18.032128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31c5b5-58be-49c6-9fb5-5efc7e8ee49d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:18.033501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31c5b5-58be-49c6-9fb5-5efc7e8ee49d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:18.046137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 355/713] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Sep 25 00:42:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:18.047041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31c5b5-58be-49c6-9fb5-5efc7e8ee49d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:18.102453 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121a2c4-44e5-44e2-9d5d-a61a7af8a392 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:18.202479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eab20-3fdf-414f-890f-22bfef233132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:18.203533 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eab20-3fdf-414f-890f-22bfef233132 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:18.204016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eab20-3fdf-414f-890f-22bfef233132 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:18.204489 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eab20-3fdf-414f-890f-22bfef233132 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:18.205415 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8eab20-3fdf-414f-890f-22bfef233132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:18.207070 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8eab20-3fdf-414f-890f-22bfef233132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:18.209413 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8eab20-3fdf-414f-890f-22bfef233132 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:18.236340 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 359/714] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:18.237312 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eab20-3fdf-414f-890f-22bfef233132 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:18.263576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:18.303424 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31c5b5-58be-49c6-9fb5-5efc7e8ee49d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:18.333758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:18.357853 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d74b6e-c0cf-47ff-80f6-fa22ac86ab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:18.358464 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d74b6e-c0cf-47ff-80f6-fa22ac86ab66 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:18.358742 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d74b6e-c0cf-47ff-80f6-fa22ac86ab66 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:18.359015 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d74b6e-c0cf-47ff-80f6-fa22ac86ab66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:18.359737 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d74b6e-c0cf-47ff-80f6-fa22ac86ab66 None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=d494b82a81ca42a69fe7d9efc2f2a251) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:18.360043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d74b6e-c0cf-47ff-80f6-fa22ac86ab66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:18.361703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d74b6e-c0cf-47ff-80f6-fa22ac86ab66 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:18.372680 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 356/715] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:18 2022] GET /identity/v3/role_assignments?user.id=d494b82a81ca42a69fe7d9efc2f2a251&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:18.373972 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d74b6e-c0cf-47ff-80f6-fa22ac86ab66 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:18.427812 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eab20-3fdf-414f-890f-22bfef233132 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:18.514752 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767803f-e6ca-48f7-b40d-068ffd6a716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:18.515780 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767803f-e6ca-48f7-b40d-068ffd6a716f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:18.516262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767803f-e6ca-48f7-b40d-068ffd6a716f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:18.516787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767803f-e6ca-48f7-b40d-068ffd6a716f None admin] PATH_INFO: `/v3/services/network` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:18.517583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767803f-e6ca-48f7-b40d-068ffd6a716f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:18.519191 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767803f-e6ca-48f7-b40d-068ffd6a716f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:18.541863 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d74b6e-c0cf-47ff-80f6-fa22ac86ab66 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-9767803f-e6ca-48f7-b40d-068ffd6a716f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:18.552580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:18.553668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:18.554508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:18.554508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:18.554508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:18.554508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:18.554508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:18.554508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:18.554508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:18.554508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:18.554508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:18.554508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:18.554508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:18.554508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:18.554508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:42:18.554508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:18.557424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 360/716] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:18 2022] GET /identity/v3/services/network => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:18.563480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767803f-e6ca-48f7-b40d-068ffd6a716f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:18.588774 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c13960-c46f-4777-b7fd-eeaddd24a024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:18.589410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c13960-c46f-4777-b7fd-eeaddd24a024 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:18.591042 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c13960-c46f-4777-b7fd-eeaddd24a024 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:18.591042 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c13960-c46f-4777-b7fd-eeaddd24a024 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:18.591242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c13960-c46f-4777-b7fd-eeaddd24a024 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:18.592866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c13960-c46f-4777-b7fd-eeaddd24a024 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:18.619363 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 357/717] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:42:18 2022] POST /identity/v3/users => generated 254 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:42:18.721138 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767803f-e6ca-48f7-b40d-068ffd6a716f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:18.729294 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:18.768018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2b109-3f5e-4167-9b89-cf5c45ba19cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:18.768681 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2b109-3f5e-4167-9b89-cf5c45ba19cf None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:18.768964 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2b109-3f5e-4167-9b89-cf5c45ba19cf None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:18.769242 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2b109-3f5e-4167-9b89-cf5c45ba19cf None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:18.769885 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2b109-3f5e-4167-9b89-cf5c45ba19cf None admin] RBAC: Adding query filter params (name=network) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:18.770193 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2b109-3f5e-4167-9b89-cf5c45ba19cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:18.771582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2b109-3f5e-4167-9b89-cf5c45ba19cf None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:18.780659 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 361/718] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Sep 25 00:42:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:18.782838 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c13960-c46f-4777-b7fd-eeaddd24a024 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:18.788918 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:18.920171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c13960-c46f-4777-b7fd-eeaddd24a024 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:18.957094 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46cbf2-8a15-446a-a2eb-ce01f346dc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:18.957709 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46cbf2-8a15-446a-a2eb-ce01f346dc64 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:18.957985 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46cbf2-8a15-446a-a2eb-ce01f346dc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:18.958257 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46cbf2-8a15-446a-a2eb-ce01f346dc64 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:18.958888 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46cbf2-8a15-446a-a2eb-ce01f346dc64 None admin] RBAC: Adding query filter params (type=network) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:18.959190 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46cbf2-8a15-446a-a2eb-ce01f346dc64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:18.960571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46cbf2-8a15-446a-a2eb-ce01f346dc64 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:18.965816 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 358/719] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Sep 25 00:42:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:19.681381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cde41-40e6-4a41-8a9d-3b34a3ffba36 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:19.681916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cde41-40e6-4a41-8a9d-3b34a3ffba36 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:19.681916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cde41-40e6-4a41-8a9d-3b34a3ffba36 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:19.683621 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 362/720] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:19.698080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabe1e0-6bb5-441c-8906-acd88c9387ab None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:19.698499 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabe1e0-6bb5-441c-8906-acd88c9387ab None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:19.698717 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabe1e0-6bb5-441c-8906-acd88c9387ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:19.722015 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-ebabe1e0-6bb5-441c-8906-acd88c9387ab None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:19.723209 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-ebabe1e0-6bb5-441c-8906-acd88c9387ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:19.797008 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:19.808464 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 359/721] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:42:20.273690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cde41-40e6-4a41-8a9d-3b34a3ffba36 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:20.406161 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cde41-40e6-4a41-8a9d-3b34a3ffba36 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:20.451630 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc949087-73e8-4c91-aad7-488c474d7b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:20.452268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc949087-73e8-4c91-aad7-488c474d7b3b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:20.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc949087-73e8-4c91-aad7-488c474d7b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:20.452840 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc949087-73e8-4c91-aad7-488c474d7b3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:20.469068 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc949087-73e8-4c91-aad7-488c474d7b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-bc949087-73e8-4c91-aad7-488c474d7b3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:20.473863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:20.474799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:20.476020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:20.476020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:20.476020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:20.476020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:20.476020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:20.476020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:20.476020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:20.476020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:20.476020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:20.476020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:20.476020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:42:20.476020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:20.476020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 363/722] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:20.481785 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabe1e0-6bb5-441c-8906-acd88c9387ab None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:20.613557 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352e58f-2166-45e9-91ae-5b64483a2a97 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:20.613883 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352e58f-2166-45e9-91ae-5b64483a2a97 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:20.614080 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352e58f-2166-45e9-91ae-5b64483a2a97 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:20.615352 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 364/723] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:20.619610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabe1e0-6bb5-441c-8906-acd88c9387ab None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:20.634450 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0aef9-d33e-4528-b231-71ed8337c393 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:20.634760 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0aef9-d33e-4528-b231-71ed8337c393 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:20.635004 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0aef9-d33e-4528-b231-71ed8337c393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:20.660854 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d2570-bf86-453c-b6b3-c6a586b26461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:20.661469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d2570-bf86-453c-b6b3-c6a586b26461 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:20.661746 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d2570-bf86-453c-b6b3-c6a586b26461 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:20.662014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d2570-bf86-453c-b6b3-c6a586b26461 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:20.662673 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d2570-bf86-453c-b6b3-c6a586b26461 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:20.662969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d2570-bf86-453c-b6b3-c6a586b26461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:20.664334 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d2570-bf86-453c-b6b3-c6a586b26461 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:20.674777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-0cd0aef9-d33e-4528-b231-71ed8337c393 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:20.675988 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-0cd0aef9-d33e-4528-b231-71ed8337c393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:20.681412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 360/724] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:42:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:20.689391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d2570-bf86-453c-b6b3-c6a586b26461 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:20.729025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:20.778886 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:20.804239 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 365/725] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:20.851344 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d2570-bf86-453c-b6b3-c6a586b26461 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:20.906178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527d8f4-5477-49f4-ad14-9f8c3357cd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:20.906818 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527d8f4-5477-49f4-ad14-9f8c3357cd0e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:20.907098 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527d8f4-5477-49f4-ad14-9f8c3357cd0e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:20.907370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527d8f4-5477-49f4-ad14-9f8c3357cd0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:20.926703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527d8f4-5477-49f4-ad14-9f8c3357cd0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:20.928172 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527d8f4-5477-49f4-ad14-9f8c3357cd0e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-8527d8f4-5477-49f4-ad14-9f8c3357cd0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:20.947331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:20.948324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:20.950370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:20.950370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:20.950370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:20.950370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 361/726] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:20.961763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0aef9-d33e-4528-b231-71ed8337c393 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:21.093999 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0aef9-d33e-4528-b231-71ed8337c393 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:21.125679 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527d8f4-5477-49f4-ad14-9f8c3357cd0e None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:21.130393 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989cc13-0b6b-4fec-80db-24bc40c01bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:21.131055 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989cc13-0b6b-4fec-80db-24bc40c01bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:21.131333 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989cc13-0b6b-4fec-80db-24bc40c01bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:21.131604 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989cc13-0b6b-4fec-80db-24bc40c01bb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:21.132578 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989cc13-0b6b-4fec-80db-24bc40c01bb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:21.132578 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989cc13-0b6b-4fec-80db-24bc40c01bb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:21.135297 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989cc13-0b6b-4fec-80db-24bc40c01bb0 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:21.147430 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 366/727] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:21.155410 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989cc13-0b6b-4fec-80db-24bc40c01bb0 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:21.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:21.262620 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527d8f4-5477-49f4-ad14-9f8c3357cd0e None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:21.274145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:21.285367 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989cc13-0b6b-4fec-80db-24bc40c01bb0 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:21.304033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbb695-5f79-42c4-910c-a385533657a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:21.304892 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbb695-5f79-42c4-910c-a385533657a5 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:21.305176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbb695-5f79-42c4-910c-a385533657a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:21.305502 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbb695-5f79-42c4-910c-a385533657a5 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:21.306161 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbb695-5f79-42c4-910c-a385533657a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:21.307537 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbb695-5f79-42c4-910c-a385533657a5 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:21.332750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 362/728] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Sep 25 00:42:21 2022] POST /identity/v3/services => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:42:21.332750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff269e64-5421-45b0-ac41-3669e195aa69 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:21.332750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff269e64-5421-45b0-ac41-3669e195aa69 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:21.332750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff269e64-5421-45b0-ac41-3669e195aa69 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:21.335677 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 363/729] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:21.337113 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83885e1-2edb-42db-90c2-ddd3ec240141 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:21.337399 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83885e1-2edb-42db-90c2-ddd3ec240141 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:21.337674 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83885e1-2edb-42db-90c2-ddd3ec240141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:21.357381 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-a83885e1-2edb-42db-90c2-ddd3ec240141 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:21.358343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fee4d1-94d9-4c0a-b1bd-fd059ac7ac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:21.359033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-a83885e1-2edb-42db-90c2-ddd3ec240141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:21.359369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fee4d1-94d9-4c0a-b1bd-fd059ac7ac7c None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:21.359797 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fee4d1-94d9-4c0a-b1bd-fd059ac7ac7c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:21.360217 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fee4d1-94d9-4c0a-b1bd-fd059ac7ac7c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:21.373186 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fee4d1-94d9-4c0a-b1bd-fd059ac7ac7c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:21.374970 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fee4d1-94d9-4c0a-b1bd-fd059ac7ac7c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-92fee4d1-94d9-4c0a-b1bd-fd059ac7ac7c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:21.399163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:21.400301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:21.401267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:21.401267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:21.401267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:21.401267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:21.401267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:21.401267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:21.401267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:21.401267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:21.401267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:42:21.401267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:21.404005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 367/730] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:42:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:21.413725 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fee4d1-94d9-4c0a-b1bd-fd059ac7ac7c None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:21.446486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 364/731] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:42:21.518872 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:21.546781 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fee4d1-94d9-4c0a-b1bd-fd059ac7ac7c None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:21.602601 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f98a2-0b5f-4b7e-9fa7-927054bca9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:21.603216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f98a2-0b5f-4b7e-9fa7-927054bca9ea None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:21.603492 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f98a2-0b5f-4b7e-9fa7-927054bca9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:21.603763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f98a2-0b5f-4b7e-9fa7-927054bca9ea None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:21.604500 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f98a2-0b5f-4b7e-9fa7-927054bca9ea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:21.604826 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f98a2-0b5f-4b7e-9fa7-927054bca9ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:21.606804 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f98a2-0b5f-4b7e-9fa7-927054bca9ea None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:21.630303 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 368/732] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Sep 25 00:42:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:21.635995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83885e1-2edb-42db-90c2-ddd3ec240141 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:21.686692 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b5429-670e-4417-807f-6e5f7333ded9 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:21.687266 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b5429-670e-4417-807f-6e5f7333ded9 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:21.688089 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b5429-670e-4417-807f-6e5f7333ded9 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:21.690231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 369/733] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:21.698142 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0bebd-fcac-4f47-9899-a4bd92de8142 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:21.698685 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0bebd-fcac-4f47-9899-a4bd92de8142 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:21.699139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0bebd-fcac-4f47-9899-a4bd92de8142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:21.723085 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-e0f0bebd-fcac-4f47-9899-a4bd92de8142 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:21.724293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-e0f0bebd-fcac-4f47-9899-a4bd92de8142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:21.755053 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:21.759714 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83885e1-2edb-42db-90c2-ddd3ec240141 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:21.802974 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce36b7-9d50-487a-97ea-15187f1075f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:21.803600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce36b7-9d50-487a-97ea-15187f1075f1 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:21.803870 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce36b7-9d50-487a-97ea-15187f1075f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:21.804129 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce36b7-9d50-487a-97ea-15187f1075f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:21.817935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 370/734] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:21.820353 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d6d09-0a70-4fdf-953c-7705cc1d7c16 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:21.820818 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d6d09-0a70-4fdf-953c-7705cc1d7c16 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:21.821494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d6d09-0a70-4fdf-953c-7705cc1d7c16 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:21.823174 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 371/735] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:21.824087 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d6d09-0a70-4fdf-953c-7705cc1d7c16 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:21.888304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce36b7-9d50-487a-97ea-15187f1075f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:21.890309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce36b7-9d50-487a-97ea-15187f1075f1 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:21.893257 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:21.934111 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d6d09-0a70-4fdf-953c-7705cc1d7c16 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:21.971494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63812acf-75d6-4c9b-b864-ee6ceacbb492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:21.972108 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63812acf-75d6-4c9b-b864-ee6ceacbb492 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:21.972395 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63812acf-75d6-4c9b-b864-ee6ceacbb492 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:21.972717 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63812acf-75d6-4c9b-b864-ee6ceacbb492 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:21.984067 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63812acf-75d6-4c9b-b864-ee6ceacbb492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-63812acf-75d6-4c9b-b864-ee6ceacbb492 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:21.989197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:21.990118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:21.990957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:21.990957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:21.990957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:21.990957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:21.990957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:21.990957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:21.990957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:21.990957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:21.990957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:21.990957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:21.990957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:42:21.990957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:21.995214 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 372/736] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:21.996724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede98f-1ee8-4875-81f1-9f8407258920 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:21.997370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede98f-1ee8-4875-81f1-9f8407258920 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:21.997498 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede98f-1ee8-4875-81f1-9f8407258920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:22.003989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:22.009918 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 365/737] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:42:21 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:42:22.010979 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce36b7-9d50-487a-97ea-15187f1075f1 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:22.017988 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-f7ede98f-1ee8-4875-81f1-9f8407258920 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:22.019261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-f7ede98f-1ee8-4875-81f1-9f8407258920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:22.097171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 373/738] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:42:22.098806 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ede98f-1ee8-4875-81f1-9f8407258920 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:22.124508 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce36b7-9d50-487a-97ea-15187f1075f1 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:22.162981 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3b531-a359-49c1-8d7f-f310de2a7294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:22.163556 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b531-a359-49c1-8d7f-f310de2a7294 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:22.163819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b531-a359-49c1-8d7f-f310de2a7294 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:22.164094 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b531-a359-49c1-8d7f-f310de2a7294 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:22.164815 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3b531-a359-49c1-8d7f-f310de2a7294 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:22.165123 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3b531-a359-49c1-8d7f-f310de2a7294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:22.166494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3b531-a359-49c1-8d7f-f310de2a7294 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:22.177439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:22.179543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 366/739] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:22.180460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3b531-a359-49c1-8d7f-f310de2a7294 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:22.235926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ede98f-1ee8-4875-81f1-9f8407258920 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:22.254533 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:22.272917 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043f0e6-3c24-44ed-b997-529d44c6078b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:22.273562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043f0e6-3c24-44ed-b997-529d44c6078b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:22.273892 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043f0e6-3c24-44ed-b997-529d44c6078b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:22.274172 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043f0e6-3c24-44ed-b997-529d44c6078b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:22.286534 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043f0e6-3c24-44ed-b997-529d44c6078b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:22.288251 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043f0e6-3c24-44ed-b997-529d44c6078b None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-2043f0e6-3c24-44ed-b997-529d44c6078b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:22.304130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:22.305339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:22.306218 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:22.306218 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:22.306218 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:22.306218 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 374/740] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:22.306759 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043f0e6-3c24-44ed-b997-529d44c6078b None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:22.307995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3b531-a359-49c1-8d7f-f310de2a7294 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:22.355517 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2444460-3f82-4d7e-841b-e71674c8bdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:22.356825 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2444460-3f82-4d7e-841b-e71674c8bdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:22.357314 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2444460-3f82-4d7e-841b-e71674c8bdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:22.358055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2444460-3f82-4d7e-841b-e71674c8bdf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:22.372060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2444460-3f82-4d7e-841b-e71674c8bdf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-c2444460-3f82-4d7e-841b-e71674c8bdf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:22.378686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:22.379656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:22.380486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:22.380486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:22.380486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:22.380486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:22.380486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:22.380486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:22.380486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:22.380486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:22.380486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:22.380486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:22.380486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:22.380486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:22.380486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 367/741] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:22.382079 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2444460-3f82-4d7e-841b-e71674c8bdf5 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:22.416937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043f0e6-3c24-44ed-b997-529d44c6078b None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:22.424460 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:22.453071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9e970-9935-4c46-8fa7-2721981efc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:22.453723 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9e970-9935-4c46-8fa7-2721981efc49 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:22.454006 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9e970-9935-4c46-8fa7-2721981efc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:22.454263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9e970-9935-4c46-8fa7-2721981efc49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:22.466879 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9e970-9935-4c46-8fa7-2721981efc49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:22.468332 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9e970-9935-4c46-8fa7-2721981efc49 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-36a9e970-9935-4c46-8fa7-2721981efc49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:22.482622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:22.483556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:22.484429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:22.484429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:22.484429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:22.484429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 375/742] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:22.484429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9e970-9935-4c46-8fa7-2721981efc49 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:22.497499 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2444460-3f82-4d7e-841b-e71674c8bdf5 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:22.521579 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:22.535285 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddd23d-98f1-4f18-94b4-b9edbcb05608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:22.535895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd23d-98f1-4f18-94b4-b9edbcb05608 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:22.536172 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd23d-98f1-4f18-94b4-b9edbcb05608 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:22.536445 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd23d-98f1-4f18-94b4-b9edbcb05608 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:22.537124 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddd23d-98f1-4f18-94b4-b9edbcb05608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:22.537425 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddd23d-98f1-4f18-94b4-b9edbcb05608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:22.538775 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddd23d-98f1-4f18-94b4-b9edbcb05608 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:22.551045 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 368/743] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:22.551822 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddd23d-98f1-4f18-94b4-b9edbcb05608 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:22.593685 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9e970-9935-4c46-8fa7-2721981efc49 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:22.626136 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d701b-163b-472c-b06b-0e25831db4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:22.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d701b-163b-472c-b06b-0e25831db4a3 None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:22.627007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d701b-163b-472c-b06b-0e25831db4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:22.627275 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d701b-163b-472c-b06b-0e25831db4a3 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:22.627922 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d701b-163b-472c-b06b-0e25831db4a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:22.629318 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d701b-163b-472c-b06b-0e25831db4a3 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:22.648787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 376/744] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Sep 25 00:42:22 2022] POST /identity/v3/services => generated 240 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:42:22.648787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d701b-163b-472c-b06b-0e25831db4a3 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:22.659184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddd23d-98f1-4f18-94b4-b9edbcb05608 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:22.668804 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:22.716816 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f00659-b59a-4ead-8784-da08fe933bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:22.717726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f00659-b59a-4ead-8784-da08fe933bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:22.718147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f00659-b59a-4ead-8784-da08fe933bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:22.718560 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f00659-b59a-4ead-8784-da08fe933bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:22.719485 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f00659-b59a-4ead-8784-da08fe933bd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:22.720037 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f00659-b59a-4ead-8784-da08fe933bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:22.721627 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f00659-b59a-4ead-8784-da08fe933bd8 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:22.732042 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 369/745] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:42:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:22.733301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f00659-b59a-4ead-8784-da08fe933bd8 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:22.781954 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:22.792341 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d701b-163b-472c-b06b-0e25831db4a3 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:22.853956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac0f81-d532-4e91-82d8-7de58d2b1e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:22.854572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac0f81-d532-4e91-82d8-7de58d2b1e27 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:22.854907 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac0f81-d532-4e91-82d8-7de58d2b1e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:22.855169 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac0f81-d532-4e91-82d8-7de58d2b1e27 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:22.855933 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac0f81-d532-4e91-82d8-7de58d2b1e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:22.856234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac0f81-d532-4e91-82d8-7de58d2b1e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:22.859070 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac0f81-d532-4e91-82d8-7de58d2b1e27 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:22.872661 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 377/746] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:22.873898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac0f81-d532-4e91-82d8-7de58d2b1e27 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:22.876899 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f00659-b59a-4ead-8784-da08fe933bd8 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:22.920858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64588dc3-a7ef-4e36-8405-46892ecaac6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:22.921732 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64588dc3-a7ef-4e36-8405-46892ecaac6a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:22.922154 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64588dc3-a7ef-4e36-8405-46892ecaac6a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:22.922567 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64588dc3-a7ef-4e36-8405-46892ecaac6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:22.932072 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64588dc3-a7ef-4e36-8405-46892ecaac6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:22.934515 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64588dc3-a7ef-4e36-8405-46892ecaac6a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-64588dc3-a7ef-4e36-8405-46892ecaac6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:22.949916 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:22.951003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:22.952083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:22.952083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:22.952083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:22.952083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:22.952083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:22.952083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:22.952083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:22.952083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:22.953929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 370/747] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:22.959180 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64588dc3-a7ef-4e36-8405-46892ecaac6a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:22.974115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:23.000268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac0f81-d532-4e91-82d8-7de58d2b1e27 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:23.035803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f6b0e-acfe-40d8-9460-f24b7924c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:23.036834 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f6b0e-acfe-40d8-9460-f24b7924c867 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:23.037327 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f6b0e-acfe-40d8-9460-f24b7924c867 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:23.037800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f6b0e-acfe-40d8-9460-f24b7924c867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:23.049303 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f6b0e-acfe-40d8-9460-f24b7924c867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:23.051069 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f6b0e-acfe-40d8-9460-f24b7924c867 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:23.057587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:23.061681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64588dc3-a7ef-4e36-8405-46892ecaac6a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-af5f6b0e-acfe-40d8-9460-f24b7924c867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:23.067666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:23.068623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:23.069982 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:23.069982 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:23.069982 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:23.072122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 378/748] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:23.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f6b0e-acfe-40d8-9460-f24b7924c867 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:23.098626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b80b2b-c0f1-4960-95a1-c352bee64e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:23.099264 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b80b2b-c0f1-4960-95a1-c352bee64e0a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:23.099566 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b80b2b-c0f1-4960-95a1-c352bee64e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:23.099850 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b80b2b-c0f1-4960-95a1-c352bee64e0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:23.108016 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b80b2b-c0f1-4960-95a1-c352bee64e0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:23.109539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b80b2b-c0f1-4960-95a1-c352bee64e0a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:23.188440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f6b0e-acfe-40d8-9460-f24b7924c867 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:23.222513 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:23.230589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287360a6-fd32-4f31-a9eb-3cf57a4c3acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:23.231540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287360a6-fd32-4f31-a9eb-3cf57a4c3acc None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:23.232017 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287360a6-fd32-4f31-a9eb-3cf57a4c3acc None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:23.232488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287360a6-fd32-4f31-a9eb-3cf57a4c3acc None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:23.233492 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287360a6-fd32-4f31-a9eb-3cf57a4c3acc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:23.233993 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287360a6-fd32-4f31-a9eb-3cf57a4c3acc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:23.235610 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287360a6-fd32-4f31-a9eb-3cf57a4c3acc None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-d4b80b2b-c0f1-4960-95a1-c352bee64e0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:23.237632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:23.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:23.239458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:23.239458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:23.239458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:23.239458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:23.239458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:23.239458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:23.239458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:23.239458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:23.239458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:42:23.239458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:23.243428 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 371/749] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Sep 25 00:42:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:23.244298 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b80b2b-c0f1-4960-95a1-c352bee64e0a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:23.256799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 379/750] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:23.257930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287360a6-fd32-4f31-a9eb-3cf57a4c3acc None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:23.347878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b80b2b-c0f1-4960-95a1-c352bee64e0a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:23.382514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83133ae3-c340-4e4c-9eb5-6253c750d8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:23.383124 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83133ae3-c340-4e4c-9eb5-6253c750d8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:23.383398 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83133ae3-c340-4e4c-9eb5-6253c750d8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:23.383666 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83133ae3-c340-4e4c-9eb5-6253c750d8f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:23.384300 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83133ae3-c340-4e4c-9eb5-6253c750d8f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:23.384650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83133ae3-c340-4e4c-9eb5-6253c750d8f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:23.386697 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83133ae3-c340-4e4c-9eb5-6253c750d8f6 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:23.391151 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287360a6-fd32-4f31-a9eb-3cf57a4c3acc None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:23.398713 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 372/751] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:23.399652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83133ae3-c340-4e4c-9eb5-6253c750d8f6 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:23.423086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:23.440005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9006a56-347b-44d1-b1bb-bf54d30133a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:23.440971 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9006a56-347b-44d1-b1bb-bf54d30133a8 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:23.441450 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9006a56-347b-44d1-b1bb-bf54d30133a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:23.441919 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9006a56-347b-44d1-b1bb-bf54d30133a8 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:23.442840 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9006a56-347b-44d1-b1bb-bf54d30133a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:23.443901 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9006a56-347b-44d1-b1bb-bf54d30133a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:23.446309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9006a56-347b-44d1-b1bb-bf54d30133a8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:23.473306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 380/752] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Sep 25 00:42:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:23.474485 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9006a56-347b-44d1-b1bb-bf54d30133a8 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:23.512182 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83133ae3-c340-4e4c-9eb5-6253c750d8f6 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:23.541974 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:23.551435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1483-f9c4-431c-881b-4d98f45d91ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:23.552034 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1483-f9c4-431c-881b-4d98f45d91ce None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:23.552309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1483-f9c4-431c-881b-4d98f45d91ce None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:23.552600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1483-f9c4-431c-881b-4d98f45d91ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:23.553321 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d1483-f9c4-431c-881b-4d98f45d91ce None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=38f2083bb2a54a9ca22546b5e7aaf032) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:23.553632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d1483-f9c4-431c-881b-4d98f45d91ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:23.555059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d1483-f9c4-431c-881b-4d98f45d91ce None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:23.568580 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 373/753] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:23 2022] GET /identity/v3/role_assignments?user.id=38f2083bb2a54a9ca22546b5e7aaf032&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:23.568580 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1483-f9c4-431c-881b-4d98f45d91ce None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:23.648434 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9006a56-347b-44d1-b1bb-bf54d30133a8 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:23.719021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac6fd1-3573-44e4-a53b-4f8a72c88e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:23.719664 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac6fd1-3573-44e4-a53b-4f8a72c88e14 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:23.719937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac6fd1-3573-44e4-a53b-4f8a72c88e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:23.720203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac6fd1-3573-44e4-a53b-4f8a72c88e14 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:23.732796 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac6fd1-3573-44e4-a53b-4f8a72c88e14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:23.734270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac6fd1-3573-44e4-a53b-4f8a72c88e14 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:23.740784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-e3ac6fd1-3573-44e4-a53b-4f8a72c88e14 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:23.753531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:23.754563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:23.755483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:23.755483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:23.755483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:23.755483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:23.755483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:23.755483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:23.755483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:23.755483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:23.755483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:42:23.755483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:23.755483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 381/754] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Sep 25 00:42:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:23.756065 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ec692-0eb0-4193-b1c7-e301cb308793 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:23.756132 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ec692-0eb0-4193-b1c7-e301cb308793 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:23.756745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ec692-0eb0-4193-b1c7-e301cb308793 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:23.757857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 382/755] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:23.760216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ec692-0eb0-4193-b1c7-e301cb308793 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:23.775310 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1483-f9c4-431c-881b-4d98f45d91ce None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:23.816581 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd5158-c733-4d7f-9653-0ee384bda6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:23.817283 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5158-c733-4d7f-9653-0ee384bda6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:23.817590 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5158-c733-4d7f-9653-0ee384bda6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:23.817862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5158-c733-4d7f-9653-0ee384bda6e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:23.832792 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd5158-c733-4d7f-9653-0ee384bda6e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:23.834280 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd5158-c733-4d7f-9653-0ee384bda6e1 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-92cd5158-c733-4d7f-9653-0ee384bda6e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:23.851527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:23.852496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:23.853530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:23.853530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:23.853530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:23.853530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 374/756] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:23.854250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c247967-472c-4297-9e37-3b32b954498b None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:23.854522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c247967-472c-4297-9e37-3b32b954498b None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:23.854843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c247967-472c-4297-9e37-3b32b954498b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:23.874081 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-1c247967-472c-4297-9e37-3b32b954498b None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:23.875291 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-1c247967-472c-4297-9e37-3b32b954498b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:23.877476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ec692-0eb0-4193-b1c7-e301cb308793 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:23.887237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:23.923309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0aa2b-0fd6-420b-b15a-87e888c84da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:23.923835 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0aa2b-0fd6-420b-b15a-87e888c84da4 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:23.924112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0aa2b-0fd6-420b-b15a-87e888c84da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:23.924384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0aa2b-0fd6-420b-b15a-87e888c84da4 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:23.925735 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0aa2b-0fd6-420b-b15a-87e888c84da4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:23.925735 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0aa2b-0fd6-420b-b15a-87e888c84da4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:23.929887 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0aa2b-0fd6-420b-b15a-87e888c84da4 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:23.958519 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 383/757] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Sep 25 00:42:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:23.958519 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0aa2b-0fd6-420b-b15a-87e888c84da4 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:23.968696 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 375/758] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:23.969595 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c247967-472c-4297-9e37-3b32b954498b None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:24.076137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0aa2b-0fd6-420b-b15a-87e888c84da4 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:24.109566 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:24.115254 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c0ab8-a01c-442b-b0ad-037d1dbeb44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:24.116099 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c0ab8-a01c-442b-b0ad-037d1dbeb44e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:24.116567 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c0ab8-a01c-442b-b0ad-037d1dbeb44e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:24.117009 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c0ab8-a01c-442b-b0ad-037d1dbeb44e None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:24.118838 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c0ab8-a01c-442b-b0ad-037d1dbeb44e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:24.118838 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c0ab8-a01c-442b-b0ad-037d1dbeb44e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:24.119776 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c0ab8-a01c-442b-b0ad-037d1dbeb44e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:24.149156 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 384/759] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:24.154745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c0ab8-a01c-442b-b0ad-037d1dbeb44e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:24.172286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c247967-472c-4297-9e37-3b32b954498b None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:24.224995 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:24.225178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100cc4e-838d-4bc9-878c-2cb7c28eda05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:24.225900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100cc4e-838d-4bc9-878c-2cb7c28eda05 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:24.225900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100cc4e-838d-4bc9-878c-2cb7c28eda05 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:24.226158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100cc4e-838d-4bc9-878c-2cb7c28eda05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:24.310657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c0ab8-a01c-442b-b0ad-037d1dbeb44e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:24.333265 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100cc4e-838d-4bc9-878c-2cb7c28eda05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:24.334725 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100cc4e-838d-4bc9-878c-2cb7c28eda05 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:24.354349 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d744fa3-be8d-42f4-acad-3e62cb4d49d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:24.355064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d744fa3-be8d-42f4-acad-3e62cb4d49d0 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:24.355339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d744fa3-be8d-42f4-acad-3e62cb4d49d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:24.355611 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d744fa3-be8d-42f4-acad-3e62cb4d49d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:24.365759 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d744fa3-be8d-42f4-acad-3e62cb4d49d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:24.367470 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d744fa3-be8d-42f4-acad-3e62cb4d49d0 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-2d744fa3-be8d-42f4-acad-3e62cb4d49d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:24.383331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:24.384248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:24.385194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:24.385194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:24.385194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:24.385194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:24.385194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:24.385194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:24.385194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:24.385194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:24.386616 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 385/760] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:24.386774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d744fa3-be8d-42f4-acad-3e62cb4d49d0 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:24.406062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:24.448846 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 376/761] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:42:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:42:24.450277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100cc4e-838d-4bc9-878c-2cb7c28eda05 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:24.506184 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:24.523477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d744fa3-be8d-42f4-acad-3e62cb4d49d0 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:24.559997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39250-31ab-450e-9313-7934c949e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:24.560815 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39250-31ab-450e-9313-7934c949e7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:24.561420 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39250-31ab-450e-9313-7934c949e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:24.561708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39250-31ab-450e-9313-7934c949e7e2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:24.562568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39250-31ab-450e-9313-7934c949e7e2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:24.563785 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100cc4e-838d-4bc9-878c-2cb7c28eda05 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:24.563971 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39250-31ab-450e-9313-7934c949e7e2 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-f7b39250-31ab-450e-9313-7934c949e7e2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:24.575997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:24.578455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:24.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 386/762] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Sep 25 00:42:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:24.589670 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39250-31ab-450e-9313-7934c949e7e2 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:24.601006 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f2408-08e6-4475-9181-2ee23779e466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:24.601675 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f2408-08e6-4475-9181-2ee23779e466 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:24.601955 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f2408-08e6-4475-9181-2ee23779e466 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:24.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f2408-08e6-4475-9181-2ee23779e466 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:24.603124 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f2408-08e6-4475-9181-2ee23779e466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:24.603477 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f2408-08e6-4475-9181-2ee23779e466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:24.605417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f2408-08e6-4475-9181-2ee23779e466 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:24.621034 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 377/763] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:24.622110 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f2408-08e6-4475-9181-2ee23779e466 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:24.657583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:24.705663 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39250-31ab-450e-9313-7934c949e7e2 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:24.745363 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaf294-24d1-4ff2-b197-f5d97fd0b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:24.746073 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf294-24d1-4ff2-b197-f5d97fd0b86d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:24.746353 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf294-24d1-4ff2-b197-f5d97fd0b86d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:24.746627 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf294-24d1-4ff2-b197-f5d97fd0b86d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:24.751838 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f2408-08e6-4475-9181-2ee23779e466 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:24.757742 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaf294-24d1-4ff2-b197-f5d97fd0b86d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:24.759119 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaf294-24d1-4ff2-b197-f5d97fd0b86d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-68aaf294-24d1-4ff2-b197-f5d97fd0b86d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:24.774875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:24.778118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:24.780230 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:24.780230 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:24.780230 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:24.780230 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 387/764] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:24.780230 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaf294-24d1-4ff2-b197-f5d97fd0b86d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:24.787955 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:24.793502 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775ac7-1f0a-4095-8dfc-bb12b430345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:24.794628 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775ac7-1f0a-4095-8dfc-bb12b430345a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:24.795091 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775ac7-1f0a-4095-8dfc-bb12b430345a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:24.795734 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775ac7-1f0a-4095-8dfc-bb12b430345a None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:24.796680 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775ac7-1f0a-4095-8dfc-bb12b430345a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:24.797172 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775ac7-1f0a-4095-8dfc-bb12b430345a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:24.798715 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775ac7-1f0a-4095-8dfc-bb12b430345a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:24.809842 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 378/765] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Sep 25 00:42:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:24.809842 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775ac7-1f0a-4095-8dfc-bb12b430345a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:24.900918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaf294-24d1-4ff2-b197-f5d97fd0b86d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:24.924414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:24.937252 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775ac7-1f0a-4095-8dfc-bb12b430345a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:24.939181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c72b2-8a94-4d2a-abbd-daf91539e492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:24.939915 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c72b2-8a94-4d2a-abbd-daf91539e492 None admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:24.940601 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c72b2-8a94-4d2a-abbd-daf91539e492 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:24.940786 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c72b2-8a94-4d2a-abbd-daf91539e492 None admin] PATH_INFO: `/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/d494b82a81ca42a69fe7d9efc2f2a251/roles/a6d585feb70946b1b1ebcaece17d26b2` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:24.942781 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c72b2-8a94-4d2a-abbd-daf91539e492 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d5f67cc330446d1b77c741139f68e15, user_id=d494b82a81ca42a69fe7d9efc2f2a251, role_id=a6d585feb70946b1b1ebcaece17d26b2)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:24.944303 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c72b2-8a94-4d2a-abbd-daf91539e492 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:24.963755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 388/766] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:42:24 2022] PUT /identity/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/d494b82a81ca42a69fe7d9efc2f2a251/roles/a6d585feb70946b1b1ebcaece17d26b2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:42:24.965176 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c72b2-8a94-4d2a-abbd-daf91539e492 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:25.005567 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee5d7-f416-43d8-bf26-1682c2adb978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:25.006229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee5d7-f416-43d8-bf26-1682c2adb978 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:25.006474 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee5d7-f416-43d8-bf26-1682c2adb978 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:25.012637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee5d7-f416-43d8-bf26-1682c2adb978 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:25.012637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ee5d7-f416-43d8-bf26-1682c2adb978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:25.012637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ee5d7-f416-43d8-bf26-1682c2adb978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:25.012637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ee5d7-f416-43d8-bf26-1682c2adb978 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:25.045106 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 379/767] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:25.050322 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee5d7-f416-43d8-bf26-1682c2adb978 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:25.067029 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:25.121584 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c72b2-8a94-4d2a-abbd-daf91539e492 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:25.170756 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffca6c-b469-46df-bdb3-03f5064f9cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:25.172442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffca6c-b469-46df-bdb3-03f5064f9cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:25.173249 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffca6c-b469-46df-bdb3-03f5064f9cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:25.173752 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffca6c-b469-46df-bdb3-03f5064f9cd5 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:25.174865 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffca6c-b469-46df-bdb3-03f5064f9cd5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:25.175835 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffca6c-b469-46df-bdb3-03f5064f9cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:25.177704 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffca6c-b469-46df-bdb3-03f5064f9cd5 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:25.178210 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee5d7-f416-43d8-bf26-1682c2adb978 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:25.186663 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 389/768] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Sep 25 00:42:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:25.188695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2d859-cfab-40c4-9752-f69ce8b68bcd None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:25.191046 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2d859-cfab-40c4-9752-f69ce8b68bcd None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:25.191046 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2d859-cfab-40c4-9752-f69ce8b68bcd None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:25.191046 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 390/769] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:25.196329 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81e63e-7ebf-44f1-936e-ab5b007b8364 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:25.196699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81e63e-7ebf-44f1-936e-ab5b007b8364 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:25.196986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81e63e-7ebf-44f1-936e-ab5b007b8364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:25.216816 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-8d81e63e-7ebf-44f1-936e-ab5b007b8364 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:25.218206 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-8d81e63e-7ebf-44f1-936e-ab5b007b8364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:25.227957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2188dc-19af-41dd-8432-6bb140646870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:25.229037 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2188dc-19af-41dd-8432-6bb140646870 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:25.230051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2188dc-19af-41dd-8432-6bb140646870 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:25.230528 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2188dc-19af-41dd-8432-6bb140646870 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:25.238412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2188dc-19af-41dd-8432-6bb140646870 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:25.240353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2188dc-19af-41dd-8432-6bb140646870 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-0b2188dc-19af-41dd-8432-6bb140646870 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:25.253435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:25.254368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:25.255254 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:25.255254 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:25.255254 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:25.255254 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:25.255254 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:25.255254 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:25.255254 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:25.255254 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:25.257975 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 380/770] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:25.259060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2188dc-19af-41dd-8432-6bb140646870 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:25.278573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:25.298990 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 391/771] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:25.300914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81e63e-7ebf-44f1-936e-ab5b007b8364 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:25.380466 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:25.436687 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2188dc-19af-41dd-8432-6bb140646870 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:25.462721 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81e63e-7ebf-44f1-936e-ab5b007b8364 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:25.484348 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bc43e-891a-4feb-9517-cc84a2d8ac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:25.485101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bc43e-891a-4feb-9517-cc84a2d8ac7f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:25.485385 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bc43e-891a-4feb-9517-cc84a2d8ac7f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:25.485660 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bc43e-891a-4feb-9517-cc84a2d8ac7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:25.486361 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bc43e-891a-4feb-9517-cc84a2d8ac7f None admin] RBAC: Adding query filter params (interface=public, service_id=825d77fe85e542d18df3171e1db7d550, region_id=RegionOne) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:25.486669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bc43e-891a-4feb-9517-cc84a2d8ac7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:25.488252 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bc43e-891a-4feb-9517-cc84a2d8ac7f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:25.500232 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb9d43-7b37-4087-a562-7aaaeb48d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:25.500963 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb9d43-7b37-4087-a562-7aaaeb48d082 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:25.501396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb9d43-7b37-4087-a562-7aaaeb48d082 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:25.501671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb9d43-7b37-4087-a562-7aaaeb48d082 None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:25.502370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb9d43-7b37-4087-a562-7aaaeb48d082 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:25.502674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb9d43-7b37-4087-a562-7aaaeb48d082 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:25.504170 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb9d43-7b37-4087-a562-7aaaeb48d082 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:25.504764 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 381/772] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Sep 25 00:42:25 2022] GET /identity/v3/endpoints?service_id=825d77fe85e542d18df3171e1db7d550&interface=public®ion_id=RegionOne => generated 194 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:25.510142 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bc43e-891a-4feb-9517-cc84a2d8ac7f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:25.517101 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 392/773] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:25.522847 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb9d43-7b37-4087-a562-7aaaeb48d082 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:25.652975 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:25.655936 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bc43e-891a-4feb-9517-cc84a2d8ac7f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:25.666639 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb9d43-7b37-4087-a562-7aaaeb48d082 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:25.683899 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:25.704893 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659bfb6-cafe-4914-bb89-d11cee187e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:25.705917 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659bfb6-cafe-4914-bb89-d11cee187e2e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:25.706349 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659bfb6-cafe-4914-bb89-d11cee187e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:25.706762 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659bfb6-cafe-4914-bb89-d11cee187e2e None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:25.707371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659bfb6-cafe-4914-bb89-d11cee187e2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:25.708776 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659bfb6-cafe-4914-bb89-d11cee187e2e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:25.710850 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6ddb5-1c47-4421-a121-c61037e7bbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:25.711633 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6ddb5-1c47-4421-a121-c61037e7bbea None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:25.712037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6ddb5-1c47-4421-a121-c61037e7bbea None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:25.712310 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6ddb5-1c47-4421-a121-c61037e7bbea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:25.713102 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6ddb5-1c47-4421-a121-c61037e7bbea None admin] RBAC: Adding query filter params (role.id=e190761ca5494052a96426d0bd344261, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=6c53cca11c1c45a89651026d2ac75cc2) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:25.713381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6ddb5-1c47-4421-a121-c61037e7bbea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:25.714769 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 382/774] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Sep 25 00:42:25 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:25.715320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6ddb5-1c47-4421-a121-c61037e7bbea None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:25.715562 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659bfb6-cafe-4914-bb89-d11cee187e2e None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:25.726825 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 393/775] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:25 2022] GET /identity/v3/role_assignments?user.id=6c53cca11c1c45a89651026d2ac75cc2&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=e190761ca5494052a96426d0bd344261 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:25.840333 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659bfb6-cafe-4914-bb89-d11cee187e2e None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:25.879880 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77108773-0a16-4e09-877a-a156bd6ad0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:25.880607 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77108773-0a16-4e09-877a-a156bd6ad0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:25.880890 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77108773-0a16-4e09-877a-a156bd6ad0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:25.881215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77108773-0a16-4e09-877a-a156bd6ad0a0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:25.881803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77108773-0a16-4e09-877a-a156bd6ad0a0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:25.883192 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77108773-0a16-4e09-877a-a156bd6ad0a0 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-77108773-0a16-4e09-877a-a156bd6ad0a0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:25.893701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:25.894779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:25.896948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 383/776] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:25 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:25.900921 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6ddb5-1c47-4421-a121-c61037e7bbea None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:26.031917 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6ddb5-1c47-4421-a121-c61037e7bbea None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:26.042137 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be016b46-a77a-4b6f-bbce-84a41f57ff4a None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:26.043842 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be016b46-a77a-4b6f-bbce-84a41f57ff4a None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:26.044386 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be016b46-a77a-4b6f-bbce-84a41f57ff4a None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:26.050420 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 384/777] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:26.052615 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e270c-8a69-405c-a01c-e2aede76a01d None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:26.053135 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e270c-8a69-405c-a01c-e2aede76a01d None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:26.053621 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e270c-8a69-405c-a01c-e2aede76a01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:26.060678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:26.080826 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-6d5e270c-8a69-405c-a01c-e2aede76a01d None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:26.082777 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-6d5e270c-8a69-405c-a01c-e2aede76a01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:26.092423 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff843e-ad56-484d-9f78-5d4032380615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:26.093198 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff843e-ad56-484d-9f78-5d4032380615 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:26.093480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff843e-ad56-484d-9f78-5d4032380615 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:26.093757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff843e-ad56-484d-9f78-5d4032380615 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:26.094401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff843e-ad56-484d-9f78-5d4032380615 None admin] RBAC: Adding query filter params (name=network) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:26.094705 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff843e-ad56-484d-9f78-5d4032380615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:26.096283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff843e-ad56-484d-9f78-5d4032380615 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:26.104825 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 394/778] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Sep 25 00:42:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:26.111770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff843e-ad56-484d-9f78-5d4032380615 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:26.188722 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:26.191456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 385/779] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:26.264353 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff843e-ad56-484d-9f78-5d4032380615 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:26.298958 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c3dc8-5455-40ab-8a08-06acefc9ed35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:26.299555 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c3dc8-5455-40ab-8a08-06acefc9ed35 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:26.299839 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c3dc8-5455-40ab-8a08-06acefc9ed35 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:26.300162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c3dc8-5455-40ab-8a08-06acefc9ed35 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:26.300822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c3dc8-5455-40ab-8a08-06acefc9ed35 None admin] RBAC: Adding query filter params (type=network) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:26.301130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c3dc8-5455-40ab-8a08-06acefc9ed35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:26.302554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c3dc8-5455-40ab-8a08-06acefc9ed35 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:26.311560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 395/780] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Sep 25 00:42:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:26.317310 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e270c-8a69-405c-a01c-e2aede76a01d None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:26.451921 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e270c-8a69-405c-a01c-e2aede76a01d None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:26.499430 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:26.505303 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02414a8e-ca75-4f2a-a156-38da64d9d629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:26.505925 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02414a8e-ca75-4f2a-a156-38da64d9d629 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:26.508900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02414a8e-ca75-4f2a-a156-38da64d9d629 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:26.509181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02414a8e-ca75-4f2a-a156-38da64d9d629 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:26.509895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02414a8e-ca75-4f2a-a156-38da64d9d629 None admin] RBAC: Adding query filter params (interface=public, service_id=2264be539bcc462fa85ab9e358bda159, region_id=RegionOne) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:26.510246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02414a8e-ca75-4f2a-a156-38da64d9d629 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:26.512190 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02414a8e-ca75-4f2a-a156-38da64d9d629 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:26.517786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 386/781] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Sep 25 00:42:26 2022] GET /identity/v3/endpoints?service_id=2264be539bcc462fa85ab9e358bda159&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:26.523240 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c3dc8-5455-40ab-8a08-06acefc9ed35 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:26.577521 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02414a8e-ca75-4f2a-a156-38da64d9d629 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:26.679042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c3dc8-5455-40ab-8a08-06acefc9ed35 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:26.689080 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:26.736662 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec81d0-d4f0-484a-b5af-4214e66b8816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:26.738891 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec81d0-d4f0-484a-b5af-4214e66b8816 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:26.739185 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec81d0-d4f0-484a-b5af-4214e66b8816 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:26.739472 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec81d0-d4f0-484a-b5af-4214e66b8816 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:26.740098 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec81d0-d4f0-484a-b5af-4214e66b8816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:26.741502 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec81d0-d4f0-484a-b5af-4214e66b8816 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:26.756523 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 396/782] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Sep 25 00:42:26 2022] GET /identity/v3/services => generated 772 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:26.771742 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02414a8e-ca75-4f2a-a156-38da64d9d629 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:26.832405 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607bc3a-f5b2-4649-814e-433530f91d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:26.833080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607bc3a-f5b2-4649-814e-433530f91d9f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:26.833360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607bc3a-f5b2-4649-814e-433530f91d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:26.833684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607bc3a-f5b2-4649-814e-433530f91d9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:26.844963 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607bc3a-f5b2-4649-814e-433530f91d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-1607bc3a-f5b2-4649-814e-433530f91d9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:26.849997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:26.850990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:26.852068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:26.852068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:26.852068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:26.852068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:26.852068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:26.852068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:26.852068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:26.852068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:26.852068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:26.852068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:26.852068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:42:26.852068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:26.852068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 387/783] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:42:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:26.861703 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec81d0-d4f0-484a-b5af-4214e66b8816 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:27.023126 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec81d0-d4f0-484a-b5af-4214e66b8816 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:27.064659 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daec686-ec5c-4fda-ac7c-46c481cb292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:27.066048 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daec686-ec5c-4fda-ac7c-46c481cb292a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:27.066565 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daec686-ec5c-4fda-ac7c-46c481cb292a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:27.067061 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daec686-ec5c-4fda-ac7c-46c481cb292a None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:27.067933 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daec686-ec5c-4fda-ac7c-46c481cb292a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:27.068440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daec686-ec5c-4fda-ac7c-46c481cb292a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:27.070046 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daec686-ec5c-4fda-ac7c-46c481cb292a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:27.084183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 397/784] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:27.085839 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607bc3a-f5b2-4649-814e-433530f91d9f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:27.151974 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:27.200770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607bc3a-f5b2-4649-814e-433530f91d9f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:27.238141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945687-f032-4513-a34d-cdbbfa94fd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:27.238839 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945687-f032-4513-a34d-cdbbfa94fd1f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:27.239124 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945687-f032-4513-a34d-cdbbfa94fd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:27.239458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945687-f032-4513-a34d-cdbbfa94fd1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:27.249780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b945687-f032-4513-a34d-cdbbfa94fd1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:27.251238 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b945687-f032-4513-a34d-cdbbfa94fd1f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-7b945687-f032-4513-a34d-cdbbfa94fd1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:27.272436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:27.273412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:27.274321 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:27.274321 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:27.274321 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:27.274321 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 388/785] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:27.280221 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daec686-ec5c-4fda-ac7c-46c481cb292a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:27.316510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:27.394522 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daec686-ec5c-4fda-ac7c-46c481cb292a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:27.439538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574c4db-5c96-45fc-9552-339bcd9fd034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:27.440180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574c4db-5c96-45fc-9552-339bcd9fd034 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:27.440460 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574c4db-5c96-45fc-9552-339bcd9fd034 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:27.440764 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574c4db-5c96-45fc-9552-339bcd9fd034 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:27.441508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574c4db-5c96-45fc-9552-339bcd9fd034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:27.441821 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574c4db-5c96-45fc-9552-339bcd9fd034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:27.443332 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574c4db-5c96-45fc-9552-339bcd9fd034 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:27.460466 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 398/786] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:27.467268 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945687-f032-4513-a34d-cdbbfa94fd1f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:27.584605 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945687-f032-4513-a34d-cdbbfa94fd1f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:27.597361 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:27.641833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9bb7d-d3d7-4636-b0bb-d5813bfe1c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:27.642471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9bb7d-d3d7-4636-b0bb-d5813bfe1c95 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:27.642748 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9bb7d-d3d7-4636-b0bb-d5813bfe1c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:27.643016 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9bb7d-d3d7-4636-b0bb-d5813bfe1c95 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:27.645429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c830f4-6168-4fa3-a2de-c0b3749201ca None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:27.645669 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c830f4-6168-4fa3-a2de-c0b3749201ca None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:27.645951 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c830f4-6168-4fa3-a2de-c0b3749201ca None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:27.648578 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 399/787] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:27.651799 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9bb7d-d3d7-4636-b0bb-d5813bfe1c95 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:27.653125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd5ac4-d931-4484-b084-cdc4d3e456d5 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:27.653312 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9bb7d-d3d7-4636-b0bb-d5813bfe1c95 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:27.653410 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd5ac4-d931-4484-b084-cdc4d3e456d5 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:27.653777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd5ac4-d931-4484-b084-cdc4d3e456d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-7dd9bb7d-d3d7-4636-b0bb-d5813bfe1c95 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:27.668139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:27.669184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:27.670128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:27.670128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:27.670128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:27.670128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:27.670128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:27.670128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:27.670128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:27.670128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:27.670128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:42:27.670128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:27.670128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 389/788] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:42:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:27.676018 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9bb7d-d3d7-4636-b0bb-d5813bfe1c95 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:27.677817 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-e1bd5ac4-d931-4484-b084-cdc4d3e456d5 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:27.679099 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-e1bd5ac4-d931-4484-b084-cdc4d3e456d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:27.814104 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9bb7d-d3d7-4636-b0bb-d5813bfe1c95 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:27.850958 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 400/789] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:27.858750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eaf71-2193-462a-b1f8-7df7d3bbfde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:27.859656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eaf71-2193-462a-b1f8-7df7d3bbfde6 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:27.860140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eaf71-2193-462a-b1f8-7df7d3bbfde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:27.860632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eaf71-2193-462a-b1f8-7df7d3bbfde6 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:27.861558 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eaf71-2193-462a-b1f8-7df7d3bbfde6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:27.862064 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eaf71-2193-462a-b1f8-7df7d3bbfde6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:27.863769 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eaf71-2193-462a-b1f8-7df7d3bbfde6 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:27.893009 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 390/790] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Sep 25 00:42:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:27.898754 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd5ac4-d931-4484-b084-cdc4d3e456d5 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:27.934639 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:28.039537 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd5ac4-d931-4484-b084-cdc4d3e456d5 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:28.089437 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d49cb-3a56-4e13-8713-7b14e203906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:28.090111 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d49cb-3a56-4e13-8713-7b14e203906e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:28.090348 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d49cb-3a56-4e13-8713-7b14e203906e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:28.090611 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d49cb-3a56-4e13-8713-7b14e203906e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:28.107163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d49cb-3a56-4e13-8713-7b14e203906e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:28.108645 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d49cb-3a56-4e13-8713-7b14e203906e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-732d49cb-3a56-4e13-8713-7b14e203906e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:28.133535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:28.134509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:28.135402 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:28.135402 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:28.135402 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:28.135402 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 401/791] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:28.141400 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eaf71-2193-462a-b1f8-7df7d3bbfde6 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:28.170477 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:28.264755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eaf71-2193-462a-b1f8-7df7d3bbfde6 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:28.308639 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77658fdc-294d-4908-93fe-0b4abeb63d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:28.309249 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77658fdc-294d-4908-93fe-0b4abeb63d59 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:28.309524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77658fdc-294d-4908-93fe-0b4abeb63d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:28.309791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77658fdc-294d-4908-93fe-0b4abeb63d59 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:28.310424 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77658fdc-294d-4908-93fe-0b4abeb63d59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:28.310722 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77658fdc-294d-4908-93fe-0b4abeb63d59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:28.312122 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77658fdc-294d-4908-93fe-0b4abeb63d59 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:28.331566 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 391/792] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:28.337237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d49cb-3a56-4e13-8713-7b14e203906e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:28.469915 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:28.493936 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a41abc-0984-4c6d-9e14-9ec2798377a1 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:28.494281 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a41abc-0984-4c6d-9e14-9ec2798377a1 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:28.494585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a41abc-0984-4c6d-9e14-9ec2798377a1 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:28.497983 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 392/793] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:28.502413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100871b0-8ee6-4145-8f29-3ac0dd6b981b None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:28.502734 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100871b0-8ee6-4145-8f29-3ac0dd6b981b None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:28.502975 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100871b0-8ee6-4145-8f29-3ac0dd6b981b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:28.505217 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d49cb-3a56-4e13-8713-7b14e203906e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:28.521048 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-100871b0-8ee6-4145-8f29-3ac0dd6b981b None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:28.522248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-100871b0-8ee6-4145-8f29-3ac0dd6b981b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:28.547194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe7f21-96f2-493c-b266-e28f6a0c46bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:28.548230 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe7f21-96f2-493c-b266-e28f6a0c46bd None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:28.549012 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe7f21-96f2-493c-b266-e28f6a0c46bd None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:28.549729 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe7f21-96f2-493c-b266-e28f6a0c46bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:28.558078 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe7f21-96f2-493c-b266-e28f6a0c46bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:28.559551 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe7f21-96f2-493c-b266-e28f6a0c46bd None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-c8fe7f21-96f2-493c-b266-e28f6a0c46bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:28.571153 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:28.572262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:28.573226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:28.573226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:28.573226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:28.573226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:28.573226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:28.573226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:28.573226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:28.573226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:28.573226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 402/794] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:28.573717 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe7f21-96f2-493c-b266-e28f6a0c46bd None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:28.600880 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 393/795] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:28.602478 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba0b41-6955-4bc3-b503-3724ad258eb8 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:28.602761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba0b41-6955-4bc3-b503-3724ad258eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:28.603036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba0b41-6955-4bc3-b503-3724ad258eb8 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:28.604880 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 394/796] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:28.609313 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba0b41-6955-4bc3-b503-3724ad258eb8 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:28.627556 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:28.704351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe7f21-96f2-493c-b266-e28f6a0c46bd None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:28.721298 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba0b41-6955-4bc3-b503-3724ad258eb8 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:28.744497 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0946f-76bf-42f9-af0f-41cac044badc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:28.745924 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0946f-76bf-42f9-af0f-41cac044badc None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:28.746407 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0946f-76bf-42f9-af0f-41cac044badc None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:28.747121 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0946f-76bf-42f9-af0f-41cac044badc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:28.752480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:28.763241 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a134e0-c566-4167-ae0e-8c84abe65e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:28.763640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0946f-76bf-42f9-af0f-41cac044badc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:28.764039 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a134e0-c566-4167-ae0e-8c84abe65e7a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:28.764432 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a134e0-c566-4167-ae0e-8c84abe65e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:28.764814 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a134e0-c566-4167-ae0e-8c84abe65e7a None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:28.765622 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a134e0-c566-4167-ae0e-8c84abe65e7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:28.765992 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a134e0-c566-4167-ae0e-8c84abe65e7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:28.767608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a134e0-c566-4167-ae0e-8c84abe65e7a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-22c0946f-76bf-42f9-af0f-41cac044badc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:28.771854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:28.772795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:28.773629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:28.773629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:28.773629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:28.773629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:28.773629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:28.773629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:28.773629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:28.773629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:28.773629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:28.773629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:28.773629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:42:28.773629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:28.777328 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 403/797] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:28.779461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf9ba9-7392-44d6-b089-e9f02b623ff5 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:28.779920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf9ba9-7392-44d6-b089-e9f02b623ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:28.780388 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf9ba9-7392-44d6-b089-e9f02b623ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:28.785921 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 395/798] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:28.785921 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a134e0-c566-4167-ae0e-8c84abe65e7a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:28.805796 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-d3bf9ba9-7392-44d6-b089-e9f02b623ff5 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:28.807018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-d3bf9ba9-7392-44d6-b089-e9f02b623ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:28.878900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:28.893772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 404/799] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:28.894598 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf9ba9-7392-44d6-b089-e9f02b623ff5 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:28.911734 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a134e0-c566-4167-ae0e-8c84abe65e7a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:28.948943 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9693c-cebb-4a0f-85e9-21ea6ee69d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:28.950020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9693c-cebb-4a0f-85e9-21ea6ee69d1b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:28.950363 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9693c-cebb-4a0f-85e9-21ea6ee69d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:28.950708 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9693c-cebb-4a0f-85e9-21ea6ee69d1b None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:28.951437 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9693c-cebb-4a0f-85e9-21ea6ee69d1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:28.951811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9693c-cebb-4a0f-85e9-21ea6ee69d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:28.953417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9693c-cebb-4a0f-85e9-21ea6ee69d1b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:28.967638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 396/800] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:42:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:28.968773 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9693c-cebb-4a0f-85e9-21ea6ee69d1b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:29.022516 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf9ba9-7392-44d6-b089-e9f02b623ff5 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:29.055065 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:29.069917 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9744d-feca-4d37-a1af-2d4d379c19a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:29.071568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9744d-feca-4d37-a1af-2d4d379c19a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:29.072497 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9744d-feca-4d37-a1af-2d4d379c19a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:29.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9744d-feca-4d37-a1af-2d4d379c19a3 None admin] PATH_INFO: `/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/38f2083bb2a54a9ca22546b5e7aaf032/roles/a6d585feb70946b1b1ebcaece17d26b2` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:29.076719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9744d-feca-4d37-a1af-2d4d379c19a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d5f67cc330446d1b77c741139f68e15, user_id=38f2083bb2a54a9ca22546b5e7aaf032, role_id=a6d585feb70946b1b1ebcaece17d26b2)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:29.078402 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9744d-feca-4d37-a1af-2d4d379c19a3 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:29.093034 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9693c-cebb-4a0f-85e9-21ea6ee69d1b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:29.098220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 405/801] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:42:28 2022] PUT /identity/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/38f2083bb2a54a9ca22546b5e7aaf032/roles/a6d585feb70946b1b1ebcaece17d26b2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:42:29.099674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9744d-feca-4d37-a1af-2d4d379c19a3 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:29.152314 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a6f23-7501-4499-9ee1-eedb576ab3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:29.153030 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a6f23-7501-4499-9ee1-eedb576ab3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:29.153254 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a6f23-7501-4499-9ee1-eedb576ab3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:29.153589 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a6f23-7501-4499-9ee1-eedb576ab3c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:29.170950 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:29.177418 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a6f23-7501-4499-9ee1-eedb576ab3c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-629a6f23-7501-4499-9ee1-eedb576ab3c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:29.183626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:29.184652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:29.185501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:29.185501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:29.185501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:29.185501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:29.185501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:29.185501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:29.185501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:29.185501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:29.185501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:29.185501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:29.185501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:29.185501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:29.185501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 397/802] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:29.191750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a6f23-7501-4499-9ee1-eedb576ab3c7 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:29.274489 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9744d-feca-4d37-a1af-2d4d379c19a3 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:29.318001 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a6f23-7501-4499-9ee1-eedb576ab3c7 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:29.330599 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35457a02-6239-465f-90b5-5745782f6b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:29.331658 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35457a02-6239-465f-90b5-5745782f6b7f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:29.332158 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35457a02-6239-465f-90b5-5745782f6b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:29.332436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35457a02-6239-465f-90b5-5745782f6b7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:29.346379 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35457a02-6239-465f-90b5-5745782f6b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:29.352236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35457a02-6239-465f-90b5-5745782f6b7f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:29.360915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1299b74-95d1-47b1-8c4d-8ea59f474e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:29.361351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1299b74-95d1-47b1-8c4d-8ea59f474e2f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:29.361630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1299b74-95d1-47b1-8c4d-8ea59f474e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:29.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1299b74-95d1-47b1-8c4d-8ea59f474e2f None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:29.362648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1299b74-95d1-47b1-8c4d-8ea59f474e2f None admin] RBAC: Adding query filter params (name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:29.362965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1299b74-95d1-47b1-8c4d-8ea59f474e2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:29.364390 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1299b74-95d1-47b1-8c4d-8ea59f474e2f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-35457a02-6239-465f-90b5-5745782f6b7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:29.369554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:29.371314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:29.372417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:29.372417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:29.372417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:29.375451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 406/803] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:29.376582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35457a02-6239-465f-90b5-5745782f6b7f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:29.377052 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 398/804] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:42:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:29.383804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1299b74-95d1-47b1-8c4d-8ea59f474e2f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:29.423664 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:29.451031 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:29.500154 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1299b74-95d1-47b1-8c4d-8ea59f474e2f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:29.503413 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35457a02-6239-465f-90b5-5745782f6b7f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:29.536455 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8811d8-9a6a-4ceb-bda3-7ce8b4d318a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:29.537019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8811d8-9a6a-4ceb-bda3-7ce8b4d318a4 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:29.537296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8811d8-9a6a-4ceb-bda3-7ce8b4d318a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:29.537398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c07f5-a696-4200-8535-713926f5e20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:29.537584 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8811d8-9a6a-4ceb-bda3-7ce8b4d318a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:29.538014 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c07f5-a696-4200-8535-713926f5e20c None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:29.538195 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8811d8-9a6a-4ceb-bda3-7ce8b4d318a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:29.538292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c07f5-a696-4200-8535-713926f5e20c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:29.538504 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8811d8-9a6a-4ceb-bda3-7ce8b4d318a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:29.538607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c07f5-a696-4200-8535-713926f5e20c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:29.539113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c07f5-a696-4200-8535-713926f5e20c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:29.539856 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8811d8-9a6a-4ceb-bda3-7ce8b4d318a4 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:29.540466 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c07f5-a696-4200-8535-713926f5e20c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-d07c07f5-a696-4200-8535-713926f5e20c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:29.551054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:29.552056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:29.552903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:29.552903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:29.552903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:29.552903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:29.552903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:29.552903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:29.552903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:29.552903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:29.552903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:29.552903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:29.552903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:29.552903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:29.552903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:42:29.552903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:29.553637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 399/805] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:29.553716 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8811d8-9a6a-4ceb-bda3-7ce8b4d318a4 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:29.557042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 407/806] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Sep 25 00:42:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:29.558903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82151afc-4601-4a33-afe3-801db1f97614 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:29.559186 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82151afc-4601-4a33-afe3-801db1f97614 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:29.559455 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82151afc-4601-4a33-afe3-801db1f97614 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:29.560878 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 408/807] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:29.561495 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82151afc-4601-4a33-afe3-801db1f97614 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:29.658513 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8811d8-9a6a-4ceb-bda3-7ce8b4d318a4 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:29.666401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82151afc-4601-4a33-afe3-801db1f97614 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:29.668493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:29.683473 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:29.699692 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b1319-2dd6-4716-8a12-f7d8de4bc9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:29.700325 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b1319-2dd6-4716-8a12-f7d8de4bc9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:29.700643 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b1319-2dd6-4716-8a12-f7d8de4bc9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:29.700922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b1319-2dd6-4716-8a12-f7d8de4bc9f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:29.702906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cca230-a6af-4fbe-85c7-58d119d32874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:29.703539 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca230-a6af-4fbe-85c7-58d119d32874 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:29.703818 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca230-a6af-4fbe-85c7-58d119d32874 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:29.704097 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca230-a6af-4fbe-85c7-58d119d32874 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:29.711935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b1319-2dd6-4716-8a12-f7d8de4bc9f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:29.712376 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cca230-a6af-4fbe-85c7-58d119d32874 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:29.713413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b1319-2dd6-4716-8a12-f7d8de4bc9f1 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:29.713889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cca230-a6af-4fbe-85c7-58d119d32874 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-57cca230-a6af-4fbe-85c7-58d119d32874 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:29.725042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:29.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:29.726931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:29.726931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:29.726931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:29.726931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:29.726931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:29.726931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:29.726931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:29.726931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:29.726931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:42:29.726931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:29.726931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 409/808] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Sep 25 00:42:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:29.727504 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cca230-a6af-4fbe-85c7-58d119d32874 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-b10b1319-2dd6-4716-8a12-f7d8de4bc9f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:29.733277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:29.734183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:29.735146 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:29.735146 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:29.735146 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:29.735146 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 400/809] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:29.735934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9edcdd-e7a2-4bab-b55c-fefd7cba1acf None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:29.736091 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9edcdd-e7a2-4bab-b55c-fefd7cba1acf None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:29.736347 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9edcdd-e7a2-4bab-b55c-fefd7cba1acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:29.755359 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-de9edcdd-e7a2-4bab-b55c-fefd7cba1acf None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:29.756592 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-de9edcdd-e7a2-4bab-b55c-fefd7cba1acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:29.840582 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 401/810] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:29.840582 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9edcdd-e7a2-4bab-b55c-fefd7cba1acf None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:29.851896 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cca230-a6af-4fbe-85c7-58d119d32874 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:29.891278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b74452-2183-4524-a23a-9a22f8f13129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:29.892162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b74452-2183-4524-a23a-9a22f8f13129 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:29.892517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b74452-2183-4524-a23a-9a22f8f13129 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:29.893272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b74452-2183-4524-a23a-9a22f8f13129 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:29.894264 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b74452-2183-4524-a23a-9a22f8f13129 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:29.894650 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b74452-2183-4524-a23a-9a22f8f13129 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:29.896606 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b74452-2183-4524-a23a-9a22f8f13129 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:29.904711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 410/811] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Sep 25 00:42:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:29.905560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b74452-2183-4524-a23a-9a22f8f13129 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:29.937467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:29.965265 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9edcdd-e7a2-4bab-b55c-fefd7cba1acf None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:29.967011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:30.003544 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22160c85-9486-4bdd-bd40-fc5e2ccae641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:30.004156 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22160c85-9486-4bdd-bd40-fc5e2ccae641 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:30.004435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22160c85-9486-4bdd-bd40-fc5e2ccae641 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:30.004753 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22160c85-9486-4bdd-bd40-fc5e2ccae641 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:30.005483 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22160c85-9486-4bdd-bd40-fc5e2ccae641 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:30.005790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22160c85-9486-4bdd-bd40-fc5e2ccae641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:30.007215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22160c85-9486-4bdd-bd40-fc5e2ccae641 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:30.025427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b74452-2183-4524-a23a-9a22f8f13129 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:30.026963 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 402/812] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Sep 25 00:42:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:30.027791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22160c85-9486-4bdd-bd40-fc5e2ccae641 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:30.065343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a82ec-7e60-4390-a718-f430a08e857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:30.065976 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a82ec-7e60-4390-a718-f430a08e857d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:30.066258 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a82ec-7e60-4390-a718-f430a08e857d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:30.066538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a82ec-7e60-4390-a718-f430a08e857d None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:30.067212 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a82ec-7e60-4390-a718-f430a08e857d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:30.067521 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a82ec-7e60-4390-a718-f430a08e857d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:30.068987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a82ec-7e60-4390-a718-f430a08e857d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:30.083446 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 411/813] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:30.084278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a82ec-7e60-4390-a718-f430a08e857d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:30.145518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22160c85-9486-4bdd-bd40-fc5e2ccae641 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:30.177976 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:30.181662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9efd14-0ba2-46b3-adde-2d6c06bb72ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:30.182758 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9efd14-0ba2-46b3-adde-2d6c06bb72ce None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:30.183162 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9efd14-0ba2-46b3-adde-2d6c06bb72ce None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:30.183363 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9efd14-0ba2-46b3-adde-2d6c06bb72ce None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:30.184161 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9efd14-0ba2-46b3-adde-2d6c06bb72ce None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:30.184466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9efd14-0ba2-46b3-adde-2d6c06bb72ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:30.185868 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9efd14-0ba2-46b3-adde-2d6c06bb72ce None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:30.191318 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 403/814] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Sep 25 00:42:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:30.194026 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a82ec-7e60-4390-a718-f430a08e857d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:30.197081 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9efd14-0ba2-46b3-adde-2d6c06bb72ce None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:30.221856 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:30.232671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c03aa-1d78-4a2d-87b4-c31d4dab59f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:30.233583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c03aa-1d78-4a2d-87b4-c31d4dab59f0 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:30.233929 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c03aa-1d78-4a2d-87b4-c31d4dab59f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:30.234203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c03aa-1d78-4a2d-87b4-c31d4dab59f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:30.298805 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9efd14-0ba2-46b3-adde-2d6c06bb72ce None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:30.302886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c03aa-1d78-4a2d-87b4-c31d4dab59f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:30.304354 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c03aa-1d78-4a2d-87b4-c31d4dab59f0 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:30.334087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899b67a-02ca-4a08-bc36-34b6d2fc5b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:30.334640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899b67a-02ca-4a08-bc36-34b6d2fc5b05 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:30.334913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899b67a-02ca-4a08-bc36-34b6d2fc5b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:30.335344 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899b67a-02ca-4a08-bc36-34b6d2fc5b05 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:30.343932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899b67a-02ca-4a08-bc36-34b6d2fc5b05 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:30.345526 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899b67a-02ca-4a08-bc36-34b6d2fc5b05 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-4899b67a-02ca-4a08-bc36-34b6d2fc5b05 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:30.363140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:30.364127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:30.365105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:30.365105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:30.365105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:30.365105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:30.365105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:30.365105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:30.365105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:30.365105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:30.365105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:42:30.365105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:30.370876 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 404/815] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Sep 25 00:42:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:30.370876 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899b67a-02ca-4a08-bc36-34b6d2fc5b05 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:30.398197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:30.417292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 412/816] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:42:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:42:30.418118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c03aa-1d78-4a2d-87b4-c31d4dab59f0 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:30.460655 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:30.478730 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899b67a-02ca-4a08-bc36-34b6d2fc5b05 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:30.515870 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d035d-fec3-4662-90fb-92dbcc5f3460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:30.516501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d035d-fec3-4662-90fb-92dbcc5f3460 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:30.516811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d035d-fec3-4662-90fb-92dbcc5f3460 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:30.517082 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d035d-fec3-4662-90fb-92dbcc5f3460 None admin] PATH_INFO: `/v3/services/network` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:30.517657 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d035d-fec3-4662-90fb-92dbcc5f3460 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:30.519006 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d035d-fec3-4662-90fb-92dbcc5f3460 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:30.526842 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c03aa-1d78-4a2d-87b4-c31d4dab59f0 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-258d035d-fec3-4662-90fb-92dbcc5f3460 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:30.530075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:30.531043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:30.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 405/817] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:30 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:30.536569 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d035d-fec3-4662-90fb-92dbcc5f3460 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:30.564043 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3228ad-ab75-49ee-a515-6cd225f137b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:30.564692 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3228ad-ab75-49ee-a515-6cd225f137b8 None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:30.564972 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3228ad-ab75-49ee-a515-6cd225f137b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:30.565247 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3228ad-ab75-49ee-a515-6cd225f137b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:30.565913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3228ad-ab75-49ee-a515-6cd225f137b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:30.567281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3228ad-ab75-49ee-a515-6cd225f137b8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:30.600671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 413/818] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Sep 25 00:42:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:42:30.600671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3228ad-ab75-49ee-a515-6cd225f137b8 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:30.657256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d035d-fec3-4662-90fb-92dbcc5f3460 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:30.670176 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:30.703871 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6d22e-3731-416e-9a31-26bfa71b9d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:30.704798 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6d22e-3731-416e-9a31-26bfa71b9d1a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:30.705308 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6d22e-3731-416e-9a31-26bfa71b9d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:30.705803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6d22e-3731-416e-9a31-26bfa71b9d1a None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:30.707002 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6d22e-3731-416e-9a31-26bfa71b9d1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:30.707320 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6d22e-3731-416e-9a31-26bfa71b9d1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:30.708832 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6d22e-3731-416e-9a31-26bfa71b9d1a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:30.730172 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 406/819] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Sep 25 00:42:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:30.731109 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6d22e-3731-416e-9a31-26bfa71b9d1a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:30.734985 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:30.760977 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3228ad-ab75-49ee-a515-6cd225f137b8 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:30.816098 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4ece2-fd6a-420f-959d-23206e2cf3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:30.817582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4ece2-fd6a-420f-959d-23206e2cf3ba None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:30.817582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4ece2-fd6a-420f-959d-23206e2cf3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:30.817582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4ece2-fd6a-420f-959d-23206e2cf3ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:30.836280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4ece2-fd6a-420f-959d-23206e2cf3ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:30.837898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4ece2-fd6a-420f-959d-23206e2cf3ba None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-e5f4ece2-fd6a-420f-959d-23206e2cf3ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:30.852994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:30.853932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:30.854844 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:30.854844 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:30.854844 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:30.854844 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 414/820] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:30.855476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4ece2-fd6a-420f-959d-23206e2cf3ba None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:30.866811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6d22e-3731-416e-9a31-26bfa71b9d1a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:30.908944 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e2969-13c4-44d9-b0ad-e73c0e28e1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:30.910167 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e2969-13c4-44d9-b0ad-e73c0e28e1bb None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:30.911107 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e2969-13c4-44d9-b0ad-e73c0e28e1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:30.911605 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e2969-13c4-44d9-b0ad-e73c0e28e1bb None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:30.912744 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e2969-13c4-44d9-b0ad-e73c0e28e1bb None admin] RBAC: Adding query filter params (name=network) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:30.913347 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e2969-13c4-44d9-b0ad-e73c0e28e1bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:30.914996 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e2969-13c4-44d9-b0ad-e73c0e28e1bb None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:30.925059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 407/821] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Sep 25 00:42:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:30.925537 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e2969-13c4-44d9-b0ad-e73c0e28e1bb None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:30.966841 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:30.974037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4ece2-fd6a-420f-959d-23206e2cf3ba None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:31.011484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:31.013184 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506a1db-eebf-436d-8057-84cb4d650f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:31.014366 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506a1db-eebf-436d-8057-84cb4d650f3f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:31.014366 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506a1db-eebf-436d-8057-84cb4d650f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:31.014563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506a1db-eebf-436d-8057-84cb4d650f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:31.027371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506a1db-eebf-436d-8057-84cb4d650f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:31.028904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506a1db-eebf-436d-8057-84cb4d650f3f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-d506a1db-eebf-436d-8057-84cb4d650f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:31.043439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:31.044401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:31.045304 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:31.045304 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:31.045304 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:31.045304 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 415/822] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:31.046061 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506a1db-eebf-436d-8057-84cb4d650f3f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:31.059228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e2969-13c4-44d9-b0ad-e73c0e28e1bb None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:31.101047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce9fd7-b4bb-43df-bfcc-fe785e615d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:31.102522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce9fd7-b4bb-43df-bfcc-fe785e615d09 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:31.103344 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce9fd7-b4bb-43df-bfcc-fe785e615d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:31.103817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce9fd7-b4bb-43df-bfcc-fe785e615d09 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:31.104707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce9fd7-b4bb-43df-bfcc-fe785e615d09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:31.105222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce9fd7-b4bb-43df-bfcc-fe785e615d09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:31.106842 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce9fd7-b4bb-43df-bfcc-fe785e615d09 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:31.121478 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 408/823] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:31.122649 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce9fd7-b4bb-43df-bfcc-fe785e615d09 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:31.151546 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506a1db-eebf-436d-8057-84cb4d650f3f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:31.189193 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cf27d-3719-451b-b889-c8b7425f125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:31.189972 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cf27d-3719-451b-b889-c8b7425f125d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:31.190171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cf27d-3719-451b-b889-c8b7425f125d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:31.190451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cf27d-3719-451b-b889-c8b7425f125d None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:31.191094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cf27d-3719-451b-b889-c8b7425f125d None admin] RBAC: Adding query filter params (type=network) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:31.191399 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cf27d-3719-451b-b889-c8b7425f125d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:31.192809 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cf27d-3719-451b-b889-c8b7425f125d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:31.202425 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 416/824] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Sep 25 00:42:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:31.202425 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cf27d-3719-451b-b889-c8b7425f125d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:31.219955 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:31.252387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce9fd7-b4bb-43df-bfcc-fe785e615d09 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:31.284234 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:31.295369 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb740f-1a3b-4066-b8dc-8fb218f40639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:31.296680 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb740f-1a3b-4066-b8dc-8fb218f40639 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:31.297180 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb740f-1a3b-4066-b8dc-8fb218f40639 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:31.297645 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb740f-1a3b-4066-b8dc-8fb218f40639 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:31.298505 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb740f-1a3b-4066-b8dc-8fb218f40639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:31.299001 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb740f-1a3b-4066-b8dc-8fb218f40639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:31.300573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb740f-1a3b-4066-b8dc-8fb218f40639 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:31.314545 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cf27d-3719-451b-b889-c8b7425f125d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:31.315002 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 409/825] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:31.315971 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb740f-1a3b-4066-b8dc-8fb218f40639 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:31.359182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521df87-7292-4c4f-a7be-ca8a4c56ad73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:31.360446 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521df87-7292-4c4f-a7be-ca8a4c56ad73 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:31.360925 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521df87-7292-4c4f-a7be-ca8a4c56ad73 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:31.361344 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521df87-7292-4c4f-a7be-ca8a4c56ad73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:31.370860 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521df87-7292-4c4f-a7be-ca8a4c56ad73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:31.372919 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521df87-7292-4c4f-a7be-ca8a4c56ad73 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-e521df87-7292-4c4f-a7be-ca8a4c56ad73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:31.384224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:31.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:31.386110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:31.386110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:31.386110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:31.386110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:31.386110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:31.386110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:31.386110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:31.386110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:31.386110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 417/826] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:31.386600 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521df87-7292-4c4f-a7be-ca8a4c56ad73 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:31.436333 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb740f-1a3b-4066-b8dc-8fb218f40639 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:31.458206 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:31.473182 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea686bf3-23f2-4d1c-baf3-61251140f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:31.473801 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea686bf3-23f2-4d1c-baf3-61251140f956 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:31.474078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea686bf3-23f2-4d1c-baf3-61251140f956 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:31.474348 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea686bf3-23f2-4d1c-baf3-61251140f956 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:31.475029 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea686bf3-23f2-4d1c-baf3-61251140f956 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:31.476423 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea686bf3-23f2-4d1c-baf3-61251140f956 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:31.502117 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 410/827] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Sep 25 00:42:31 2022] POST /identity/v3/endpoints => generated 337 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:42:31.503786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17a49b-f680-4285-a78f-b411ee85c383 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:31.504336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17a49b-f680-4285-a78f-b411ee85c383 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:31.504852 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17a49b-f680-4285-a78f-b411ee85c383 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:31.506865 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 411/828] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:31.508017 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17a49b-f680-4285-a78f-b411ee85c383 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:31.565598 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:31.618659 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521df87-7292-4c4f-a7be-ca8a4c56ad73 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:31.658808 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17a49b-f680-4285-a78f-b411ee85c383 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:31.663793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b814370-352d-43aa-ae8d-399c5cc90b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:31.664439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814370-352d-43aa-ae8d-399c5cc90b87 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:31.664743 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814370-352d-43aa-ae8d-399c5cc90b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:31.665015 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814370-352d-43aa-ae8d-399c5cc90b87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:31.673429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b814370-352d-43aa-ae8d-399c5cc90b87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:31.674996 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b814370-352d-43aa-ae8d-399c5cc90b87 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-3b814370-352d-43aa-ae8d-399c5cc90b87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:31.687914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:31.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:31.689800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:31.689800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:31.689800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:31.689800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:31.689800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:31.689800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:31.689800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:31.689800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:31.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 418/829] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff8dd8-baee-4606-8592-dfd8ebae5bfb None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:31.695018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff8dd8-baee-4606-8592-dfd8ebae5bfb None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:31.695291 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff8dd8-baee-4606-8592-dfd8ebae5bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:31.708283 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76311fe-6a77-4ccd-b93b-6d2f385b787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:31.709341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76311fe-6a77-4ccd-b93b-6d2f385b787d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:31.709828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76311fe-6a77-4ccd-b93b-6d2f385b787d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:31.710338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76311fe-6a77-4ccd-b93b-6d2f385b787d None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:31.711897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76311fe-6a77-4ccd-b93b-6d2f385b787d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:31.712720 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76311fe-6a77-4ccd-b93b-6d2f385b787d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:31.714944 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76311fe-6a77-4ccd-b93b-6d2f385b787d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:31.717042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-27ff8dd8-baee-4606-8592-dfd8ebae5bfb None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:31.718411 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-27ff8dd8-baee-4606-8592-dfd8ebae5bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:31.730213 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 412/830] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:31.731333 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76311fe-6a77-4ccd-b93b-6d2f385b787d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:31.809718 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 419/831] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:31.813675 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff8dd8-baee-4606-8592-dfd8ebae5bfb None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:31.851282 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:31.858820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76311fe-6a77-4ccd-b93b-6d2f385b787d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:31.892803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:31.898274 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d7133-3e39-4096-8c6c-85284b0e5fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:31.899161 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d7133-3e39-4096-8c6c-85284b0e5fac None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:31.899644 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d7133-3e39-4096-8c6c-85284b0e5fac None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:31.900129 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d7133-3e39-4096-8c6c-85284b0e5fac None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:31.901776 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d7133-3e39-4096-8c6c-85284b0e5fac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:31.902326 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d7133-3e39-4096-8c6c-85284b0e5fac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:31.904039 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d7133-3e39-4096-8c6c-85284b0e5fac None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:31.917373 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 413/832] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:31.923533 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d7133-3e39-4096-8c6c-85284b0e5fac None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:31.941325 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff8dd8-baee-4606-8592-dfd8ebae5bfb None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:31.982958 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba7bfa-9f0a-4f64-9e7e-aa8f33954f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:31.983563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba7bfa-9f0a-4f64-9e7e-aa8f33954f94 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:31.984356 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba7bfa-9f0a-4f64-9e7e-aa8f33954f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:31.984682 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba7bfa-9f0a-4f64-9e7e-aa8f33954f94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:31.985413 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba7bfa-9f0a-4f64-9e7e-aa8f33954f94 None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=d494b82a81ca42a69fe7d9efc2f2a251) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:31.985720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba7bfa-9f0a-4f64-9e7e-aa8f33954f94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:31.987655 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba7bfa-9f0a-4f64-9e7e-aa8f33954f94 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:31.996341 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 420/833] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:31 2022] GET /identity/v3/role_assignments?user.id=d494b82a81ca42a69fe7d9efc2f2a251&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:32.046276 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d7133-3e39-4096-8c6c-85284b0e5fac None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:32.087439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e1ab-c007-43fe-99e9-3d293cbf0059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:32.088951 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e1ab-c007-43fe-99e9-3d293cbf0059 None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:32.089389 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e1ab-c007-43fe-99e9-3d293cbf0059 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:32.089814 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e1ab-c007-43fe-99e9-3d293cbf0059 None admin] PATH_INFO: `/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/6c53cca11c1c45a89651026d2ac75cc2/roles/e190761ca5494052a96426d0bd344261` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:32.099087 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba7bfa-9f0a-4f64-9e7e-aa8f33954f94 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:32.109436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30e1ab-c007-43fe-99e9-3d293cbf0059 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d5f67cc330446d1b77c741139f68e15, user_id=6c53cca11c1c45a89651026d2ac75cc2, role_id=e190761ca5494052a96426d0bd344261)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:32.111605 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30e1ab-c007-43fe-99e9-3d293cbf0059 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:32.128541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 414/834] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:42:31 2022] PUT /identity/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/6c53cca11c1c45a89651026d2ac75cc2/roles/e190761ca5494052a96426d0bd344261 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:42:32.230279 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba7bfa-9f0a-4f64-9e7e-aa8f33954f94 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:32.255018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:32.272736 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291afaa-01db-4910-8cf3-c51afb98d5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:32.273419 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291afaa-01db-4910-8cf3-c51afb98d5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:32.273697 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291afaa-01db-4910-8cf3-c51afb98d5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:32.273968 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291afaa-01db-4910-8cf3-c51afb98d5d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:32.290876 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291afaa-01db-4910-8cf3-c51afb98d5d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-a291afaa-01db-4910-8cf3-c51afb98d5d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:32.296956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:32.297916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:32.298741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:32.298741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:32.298741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:32.298741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:32.298741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:32.298741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:32.298741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:32.298741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:32.298741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:32.298741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:32.298741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:42:32.298741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:32.299852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 421/835] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:42:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:32.306105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e1ab-c007-43fe-99e9-3d293cbf0059 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:32.318444 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:32.421661 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e1ab-c007-43fe-99e9-3d293cbf0059 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:32.457162 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac444a-e8aa-4610-aaba-8cffb2d6051b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:32.458075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac444a-e8aa-4610-aaba-8cffb2d6051b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:32.458529 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac444a-e8aa-4610-aaba-8cffb2d6051b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:32.458974 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac444a-e8aa-4610-aaba-8cffb2d6051b None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:32.459805 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac444a-e8aa-4610-aaba-8cffb2d6051b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:32.460302 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac444a-e8aa-4610-aaba-8cffb2d6051b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:32.461854 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac444a-e8aa-4610-aaba-8cffb2d6051b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:32.471497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 415/836] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:42:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:32.478196 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291afaa-01db-4910-8cf3-c51afb98d5d2 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:32.590684 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291afaa-01db-4910-8cf3-c51afb98d5d2 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:32.627378 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b906156-f5a4-418f-a6ce-85ed977a6b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:32.628009 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b906156-f5a4-418f-a6ce-85ed977a6b8d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:32.628285 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b906156-f5a4-418f-a6ce-85ed977a6b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:32.628582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b906156-f5a4-418f-a6ce-85ed977a6b8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:32.639573 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b906156-f5a4-418f-a6ce-85ed977a6b8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:32.641045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b906156-f5a4-418f-a6ce-85ed977a6b8d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-8b906156-f5a4-418f-a6ce-85ed977a6b8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:32.656975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:32.657949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:32.659235 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:32.659235 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:32.659235 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:32.659235 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 422/837] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:32.664234 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac444a-e8aa-4610-aaba-8cffb2d6051b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:32.742619 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:32.780255 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac444a-e8aa-4610-aaba-8cffb2d6051b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:32.819892 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce8d6d-cd18-41d4-8e55-e8d557225a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:32.820842 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8d6d-cd18-41d4-8e55-e8d557225a11 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:32.821131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8d6d-cd18-41d4-8e55-e8d557225a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:32.821401 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8d6d-cd18-41d4-8e55-e8d557225a11 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:32.822136 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce8d6d-cd18-41d4-8e55-e8d557225a11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:32.822447 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce8d6d-cd18-41d4-8e55-e8d557225a11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:32.824432 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce8d6d-cd18-41d4-8e55-e8d557225a11 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:32.839434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 416/838] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:32.845126 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b906156-f5a4-418f-a6ce-85ed977a6b8d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:32.877762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:32.933515 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea67d-1bba-46d2-955a-15f8dd9dee1b None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:32.933844 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea67d-1bba-46d2-955a-15f8dd9dee1b None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:32.934077 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea67d-1bba-46d2-955a-15f8dd9dee1b None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:32.935691 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 417/839] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:32.940661 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e8e38-03d7-42d1-b705-a16f1758b1d2 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:32.940949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e8e38-03d7-42d1-b705-a16f1758b1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:32.941231 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e8e38-03d7-42d1-b705-a16f1758b1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:32.957156 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b906156-f5a4-418f-a6ce-85ed977a6b8d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:32.961195 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-257e8e38-03d7-42d1-b705-a16f1758b1d2 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:32.962416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-257e8e38-03d7-42d1-b705-a16f1758b1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:33.002136 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc40327-cc2b-4ec7-96c2-5cfde9708ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:33.002783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40327-cc2b-4ec7-96c2-5cfde9708ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:33.003062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40327-cc2b-4ec7-96c2-5cfde9708ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:33.003333 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40327-cc2b-4ec7-96c2-5cfde9708ff3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:33.014704 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc40327-cc2b-4ec7-96c2-5cfde9708ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:33.017154 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc40327-cc2b-4ec7-96c2-5cfde9708ff3 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-ddc40327-cc2b-4ec7-96c2-5cfde9708ff3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:33.035371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:33.036375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:33.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:33.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:33.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:33.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:33.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:33.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:33.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:33.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:33.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:42:33.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:33.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 423/840] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:42:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:33.043909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc40327-cc2b-4ec7-96c2-5cfde9708ff3 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:33.044642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 418/841] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:33.143525 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:33.155360 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc40327-cc2b-4ec7-96c2-5cfde9708ff3 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:33.190871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2d0e0-29b1-4a69-995d-d574a66b83b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:33.191480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2d0e0-29b1-4a69-995d-d574a66b83b1 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:33.191759 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2d0e0-29b1-4a69-995d-d574a66b83b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:33.192034 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2d0e0-29b1-4a69-995d-d574a66b83b1 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:33.192809 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2d0e0-29b1-4a69-995d-d574a66b83b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:33.193117 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2d0e0-29b1-4a69-995d-d574a66b83b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:33.194593 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2d0e0-29b1-4a69-995d-d574a66b83b1 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:33.213466 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 424/842] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Sep 25 00:42:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:33.219213 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e8e38-03d7-42d1-b705-a16f1758b1d2 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:33.281333 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:33.312243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2d0e0-29b1-4a69-995d-d574a66b83b1 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:33.332404 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e8e38-03d7-42d1-b705-a16f1758b1d2 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:33.367324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1327f73-8389-4115-ac94-9b1aae6a9bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:33.367944 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1327f73-8389-4115-ac94-9b1aae6a9bff None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:33.368564 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1327f73-8389-4115-ac94-9b1aae6a9bff None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:33.368564 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1327f73-8389-4115-ac94-9b1aae6a9bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:33.440989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2d0e0-29b1-4a69-995d-d574a66b83b1 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:33.449697 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1327f73-8389-4115-ac94-9b1aae6a9bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:33.451889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1327f73-8389-4115-ac94-9b1aae6a9bff None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:33.477009 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a063bf4-64d3-48e0-90c5-f16fe6a9e4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:33.477636 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a063bf4-64d3-48e0-90c5-f16fe6a9e4ef None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:33.477912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a063bf4-64d3-48e0-90c5-f16fe6a9e4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:33.478181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a063bf4-64d3-48e0-90c5-f16fe6a9e4ef None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:33.479283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a063bf4-64d3-48e0-90c5-f16fe6a9e4ef None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:33.480948 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a063bf4-64d3-48e0-90c5-f16fe6a9e4ef None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-6a063bf4-64d3-48e0-90c5-f16fe6a9e4ef None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:33.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:33.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:33.492496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 425/843] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:42:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:33.499820 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a063bf4-64d3-48e0-90c5-f16fe6a9e4ef None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:33.516705 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:33.533012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:33.568594 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 419/844] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:42:33 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:42:33.574711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1327f73-8389-4115-ac94-9b1aae6a9bff None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:33.623088 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a063bf4-64d3-48e0-90c5-f16fe6a9e4ef None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:33.668112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7d754-3a89-4c0a-8274-f3aec9ce131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:33.669081 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d754-3a89-4c0a-8274-f3aec9ce131b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:33.669809 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d754-3a89-4c0a-8274-f3aec9ce131b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:33.670731 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d754-3a89-4c0a-8274-f3aec9ce131b None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:33.671826 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7d754-3a89-4c0a-8274-f3aec9ce131b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:33.672348 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7d754-3a89-4c0a-8274-f3aec9ce131b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:33.674482 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7d754-3a89-4c0a-8274-f3aec9ce131b None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:33.680855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 426/845] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:42:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:33.686376 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7d754-3a89-4c0a-8274-f3aec9ce131b None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:33.696848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1327f73-8389-4115-ac94-9b1aae6a9bff None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:33.738900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d71be-787a-4549-9d64-aa4f5ba36602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:33.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d71be-787a-4549-9d64-aa4f5ba36602 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:33.740406 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d71be-787a-4549-9d64-aa4f5ba36602 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:33.741147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d71be-787a-4549-9d64-aa4f5ba36602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:33.753806 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d71be-787a-4549-9d64-aa4f5ba36602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:33.755590 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d71be-787a-4549-9d64-aa4f5ba36602 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-9b4d71be-787a-4549-9d64-aa4f5ba36602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:33.772784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:33.773949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:33.774895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:33.774895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:33.774895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:33.775594 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 420/846] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:33.782203 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d71be-787a-4549-9d64-aa4f5ba36602 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:33.785216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:33.800662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:33.812872 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7d754-3a89-4c0a-8274-f3aec9ce131b None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:33.858076 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d804c-6e00-4004-86c3-d4bb2c2f89dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:33.858695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d804c-6e00-4004-86c3-d4bb2c2f89dd None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:33.859070 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d804c-6e00-4004-86c3-d4bb2c2f89dd None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:33.859443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d804c-6e00-4004-86c3-d4bb2c2f89dd None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:33.860181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d804c-6e00-4004-86c3-d4bb2c2f89dd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:33.860620 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d804c-6e00-4004-86c3-d4bb2c2f89dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:33.862194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d804c-6e00-4004-86c3-d4bb2c2f89dd None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:33.872583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 427/847] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:42:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:33.912760 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d71be-787a-4549-9d64-aa4f5ba36602 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:33.951665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef2f89-e8f3-44c2-9521-331bf8e7d115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:33.952208 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef2f89-e8f3-44c2-9521-331bf8e7d115 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:33.952485 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef2f89-e8f3-44c2-9521-331bf8e7d115 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:33.952788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef2f89-e8f3-44c2-9521-331bf8e7d115 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:33.953448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef2f89-e8f3-44c2-9521-331bf8e7d115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:33.953753 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef2f89-e8f3-44c2-9521-331bf8e7d115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:33.955226 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef2f89-e8f3-44c2-9521-331bf8e7d115 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:33.969765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 421/848] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:33.975987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d804c-6e00-4004-86c3-d4bb2c2f89dd None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:34.100720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d804c-6e00-4004-86c3-d4bb2c2f89dd None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:34.138771 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edccd7b-b210-452c-b7af-21b42b954a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:34.139788 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edccd7b-b210-452c-b7af-21b42b954a3e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:34.140263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edccd7b-b210-452c-b7af-21b42b954a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:34.140774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edccd7b-b210-452c-b7af-21b42b954a3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:34.147910 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edccd7b-b210-452c-b7af-21b42b954a3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:34.149603 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edccd7b-b210-452c-b7af-21b42b954a3e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-4edccd7b-b210-452c-b7af-21b42b954a3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:34.167459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:34.168373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:34.169270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:34.169270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:34.169270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:34.169270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:34.169270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:34.169270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:34.169270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:34.169270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:34.171650 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 428/849] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:34.179696 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef2f89-e8f3-44c2-9521-331bf8e7d115 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:34.256671 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:34.287108 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef2f89-e8f3-44c2-9521-331bf8e7d115 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:34.319396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91180d-6339-47f3-9b70-93d071d50de3 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:34.319904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91180d-6339-47f3-9b70-93d071d50de3 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:34.319904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91180d-6339-47f3-9b70-93d071d50de3 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:34.322391 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 429/850] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:34.327773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e9aee-80f8-446f-8755-0f3d6a85e643 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:34.327979 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0b929-8bd4-486d-b10e-64aeb29631d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:34.328506 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e9aee-80f8-446f-8755-0f3d6a85e643 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:34.328726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0b929-8bd4-486d-b10e-64aeb29631d7 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:34.328947 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0b929-8bd4-486d-b10e-64aeb29631d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:34.329221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0b929-8bd4-486d-b10e-64aeb29631d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:34.329595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e9aee-80f8-446f-8755-0f3d6a85e643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:34.330037 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0b929-8bd4-486d-b10e-64aeb29631d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:34.330272 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0b929-8bd4-486d-b10e-64aeb29631d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:34.331699 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0b929-8bd4-486d-b10e-64aeb29631d7 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:34.337049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:34.351536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 422/851] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:34.357982 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0b929-8bd4-486d-b10e-64aeb29631d7 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:34.362481 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-061e9aee-80f8-446f-8755-0f3d6a85e643 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:34.364137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-061e9aee-80f8-446f-8755-0f3d6a85e643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:34.450280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 430/852] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:34.478159 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0b929-8bd4-486d-b10e-64aeb29631d7 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:34.491057 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ce8ff-8171-4dc8-9fc9-fa581c83925e None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:34.491333 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ce8ff-8171-4dc8-9fc9-fa581c83925e None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:34.491606 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ce8ff-8171-4dc8-9fc9-fa581c83925e None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:34.493565 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 431/853] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:42:34.499003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32568a-f4b0-495e-bb91-62502e090762 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:34.499284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32568a-f4b0-495e-bb91-62502e090762 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:34.499559 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32568a-f4b0-495e-bb91-62502e090762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:34.517329 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:34.517594 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-0e32568a-f4b0-495e-bb91-62502e090762 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:34.519070 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-0e32568a-f4b0-495e-bb91-62502e090762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:34.523896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd30e7-4a84-4bcd-976f-fa8a3dadcdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:34.524876 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd30e7-4a84-4bcd-976f-fa8a3dadcdbf None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:34.525371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd30e7-4a84-4bcd-976f-fa8a3dadcdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:34.526359 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd30e7-4a84-4bcd-976f-fa8a3dadcdbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:34.527294 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd30e7-4a84-4bcd-976f-fa8a3dadcdbf None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=38f2083bb2a54a9ca22546b5e7aaf032) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:34.527798 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd30e7-4a84-4bcd-976f-fa8a3dadcdbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:34.529447 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd30e7-4a84-4bcd-976f-fa8a3dadcdbf None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:34.535965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 423/854] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:34 2022] GET /identity/v3/role_assignments?user.id=38f2083bb2a54a9ca22546b5e7aaf032&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:34.601265 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 432/855] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:34.731253 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd30e7-4a84-4bcd-976f-fa8a3dadcdbf None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:34.836579 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd30e7-4a84-4bcd-976f-fa8a3dadcdbf None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:34.873427 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785775f9-9db3-45e5-93ed-da382859a569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:34.874452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785775f9-9db3-45e5-93ed-da382859a569 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:34.874936 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785775f9-9db3-45e5-93ed-da382859a569 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:34.875402 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785775f9-9db3-45e5-93ed-da382859a569 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:34.876175 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785775f9-9db3-45e5-93ed-da382859a569 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:34.877839 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785775f9-9db3-45e5-93ed-da382859a569 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:34.885486 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32568a-f4b0-495e-bb91-62502e090762 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-785775f9-9db3-45e5-93ed-da382859a569 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:34.888076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:34.889041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:34.889967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:34.889967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:34.889967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:34.889967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:34.889967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:34.889967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:34.889967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:34.889967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:34.889967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:34.889967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:34.889967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:34.889967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:34.889967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:42:34.889967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:34.896741 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 424/856] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Sep 25 00:42:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:34.898445 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785775f9-9db3-45e5-93ed-da382859a569 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:34.956731 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:34.973071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:35.008299 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32568a-f4b0-495e-bb91-62502e090762 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:35.017211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785775f9-9db3-45e5-93ed-da382859a569 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:35.055591 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00845644-46ff-42f5-96f8-615ed0a8006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:35.056469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845644-46ff-42f5-96f8-615ed0a8006b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:35.056655 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee7be1-a092-4bf0-8131-6dc2cf38ad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:35.057101 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845644-46ff-42f5-96f8-615ed0a8006b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:35.057496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee7be1-a092-4bf0-8131-6dc2cf38ad03 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:35.057705 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845644-46ff-42f5-96f8-615ed0a8006b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:35.057948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee7be1-a092-4bf0-8131-6dc2cf38ad03 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:35.058311 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee7be1-a092-4bf0-8131-6dc2cf38ad03 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:35.059219 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee7be1-a092-4bf0-8131-6dc2cf38ad03 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:35.059668 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee7be1-a092-4bf0-8131-6dc2cf38ad03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:35.061189 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee7be1-a092-4bf0-8131-6dc2cf38ad03 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:35.066364 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 425/857] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Sep 25 00:42:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:35.071552 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00845644-46ff-42f5-96f8-615ed0a8006b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:35.074110 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee7be1-a092-4bf0-8131-6dc2cf38ad03 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-00845644-46ff-42f5-96f8-615ed0a8006b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:35.077568 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:35.078657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:35.079706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:35.079706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:35.079706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:35.079706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:35.079706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:35.079706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:35.079706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:35.079706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:35.079706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:35.079706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:35.079706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:42:35.079706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:35.082880 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 433/858] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:42:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:35.090275 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00845644-46ff-42f5-96f8-615ed0a8006b None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:35.185820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee7be1-a092-4bf0-8131-6dc2cf38ad03 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:35.198629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00845644-46ff-42f5-96f8-615ed0a8006b None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:35.211840 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:35.225237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:35.225405 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497e438-da20-491b-9313-691dbac7ff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:35.226836 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497e438-da20-491b-9313-691dbac7ff33 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:35.227018 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497e438-da20-491b-9313-691dbac7ff33 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:35.227238 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497e438-da20-491b-9313-691dbac7ff33 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:35.227929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497e438-da20-491b-9313-691dbac7ff33 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:35.228308 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497e438-da20-491b-9313-691dbac7ff33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:35.229977 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497e438-da20-491b-9313-691dbac7ff33 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:35.236705 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 426/859] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Sep 25 00:42:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:35.246625 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce44310-2f61-48eb-a8e0-155fc6828aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:35.247651 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce44310-2f61-48eb-a8e0-155fc6828aec None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:35.248126 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce44310-2f61-48eb-a8e0-155fc6828aec None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:35.248646 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce44310-2f61-48eb-a8e0-155fc6828aec None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:35.249551 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce44310-2f61-48eb-a8e0-155fc6828aec None admin] RBAC: Adding query filter params (name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:35.250085 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce44310-2f61-48eb-a8e0-155fc6828aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:35.251795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce44310-2f61-48eb-a8e0-155fc6828aec None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:35.267019 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 434/860] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:42:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:35.268844 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497e438-da20-491b-9313-691dbac7ff33 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:35.380191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497e438-da20-491b-9313-691dbac7ff33 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:35.419168 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02d9ea-b379-4bf4-96c0-076be6031115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:35.420193 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02d9ea-b379-4bf4-96c0-076be6031115 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:35.420727 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02d9ea-b379-4bf4-96c0-076be6031115 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:35.421195 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02d9ea-b379-4bf4-96c0-076be6031115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:35.433272 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02d9ea-b379-4bf4-96c0-076be6031115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:35.435096 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02d9ea-b379-4bf4-96c0-076be6031115 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-cf02d9ea-b379-4bf4-96c0-076be6031115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:35.451809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:35.452788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:35.453669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:35.453669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:35.453669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:35.456702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 427/861] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:35.459245 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce44310-2f61-48eb-a8e0-155fc6828aec None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:35.565243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce44310-2f61-48eb-a8e0-155fc6828aec None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:35.599677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bec8d5-7fff-4c0b-a647-a47622178363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:35.600633 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bec8d5-7fff-4c0b-a647-a47622178363 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:35.601108 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bec8d5-7fff-4c0b-a647-a47622178363 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:35.601674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bec8d5-7fff-4c0b-a647-a47622178363 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:35.602502 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bec8d5-7fff-4c0b-a647-a47622178363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:35.603013 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bec8d5-7fff-4c0b-a647-a47622178363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:35.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bec8d5-7fff-4c0b-a647-a47622178363 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:35.617028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 435/862] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:35.623417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02d9ea-b379-4bf4-96c0-076be6031115 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:35.666870 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:35.731451 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02d9ea-b379-4bf4-96c0-076be6031115 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:35.765416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d5e53-7045-4f12-aa94-a16e4f50be81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:35.766321 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d5e53-7045-4f12-aa94-a16e4f50be81 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:35.766772 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d5e53-7045-4f12-aa94-a16e4f50be81 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:35.767243 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d5e53-7045-4f12-aa94-a16e4f50be81 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:35.775010 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d5e53-7045-4f12-aa94-a16e4f50be81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:35.776739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d5e53-7045-4f12-aa94-a16e4f50be81 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-032d5e53-7045-4f12-aa94-a16e4f50be81 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:35.788353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:35.789336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:35.790270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:35.790270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:35.790270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:35.790270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:35.790270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:35.790270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:35.790270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:35.790270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:35.790270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:42:35.790270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:35.796717 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 428/863] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Sep 25 00:42:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:35.799446 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bec8d5-7fff-4c0b-a647-a47622178363 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:35.864936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:35.910558 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bec8d5-7fff-4c0b-a647-a47622178363 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:35.946047 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e879d69-2388-47dc-9d6d-3ca6e329b695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:35.946574 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e879d69-2388-47dc-9d6d-3ca6e329b695 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:35.946852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e879d69-2388-47dc-9d6d-3ca6e329b695 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:35.947182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e879d69-2388-47dc-9d6d-3ca6e329b695 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:35.947933 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e879d69-2388-47dc-9d6d-3ca6e329b695 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:35.948289 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e879d69-2388-47dc-9d6d-3ca6e329b695 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:35.949862 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e879d69-2388-47dc-9d6d-3ca6e329b695 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:35.971535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 436/864] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Sep 25 00:42:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:35.972893 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d5e53-7045-4f12-aa94-a16e4f50be81 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:36.083747 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:36.086894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d5e53-7045-4f12-aa94-a16e4f50be81 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:36.123670 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbad99-6297-46f1-9be8-3cf9c9ac4f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:36.124606 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbad99-6297-46f1-9be8-3cf9c9ac4f9a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:36.125071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbad99-6297-46f1-9be8-3cf9c9ac4f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:36.125525 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbad99-6297-46f1-9be8-3cf9c9ac4f9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:36.182462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8667ddc-bb6f-4c6b-8d1f-d0db0e6ff842 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:36.182817 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8667ddc-bb6f-4c6b-8d1f-d0db0e6ff842 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:36.183003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8667ddc-bb6f-4c6b-8d1f-d0db0e6ff842 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:36.188213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 437/865] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:36.189355 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaab6f-e61b-41b0-a888-defbce3e11b6 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:36.189686 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaab6f-e61b-41b0-a888-defbce3e11b6 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:36.189965 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaab6f-e61b-41b0-a888-defbce3e11b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:36.197907 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbad99-6297-46f1-9be8-3cf9c9ac4f9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:36.199318 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbad99-6297-46f1-9be8-3cf9c9ac4f9a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:36.208401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-d5aaab6f-e61b-41b0-a888-defbce3e11b6 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:36.209663 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-d5aaab6f-e61b-41b0-a888-defbce3e11b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:36.281183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 438/866] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:36.302732 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:36.306802 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 429/867] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:42:35 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:42:36.314227 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aaab6f-e61b-41b0-a888-defbce3e11b6 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:36.349413 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:36.420299 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aaab6f-e61b-41b0-a888-defbce3e11b6 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:36.455552 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e559e3-7ec9-4ee6-9b9d-89b53e0de1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:36.456111 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e559e3-7ec9-4ee6-9b9d-89b53e0de1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:36.456385 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e559e3-7ec9-4ee6-9b9d-89b53e0de1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:36.456684 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e559e3-7ec9-4ee6-9b9d-89b53e0de1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:36.467289 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e559e3-7ec9-4ee6-9b9d-89b53e0de1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:36.468749 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e559e3-7ec9-4ee6-9b9d-89b53e0de1e6 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-c8e559e3-7ec9-4ee6-9b9d-89b53e0de1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:36.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:36.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:36.485737 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:36.485737 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:36.485737 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:36.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 439/868] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:36.490980 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbad99-6297-46f1-9be8-3cf9c9ac4f9a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:36.567245 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e559e3-7ec9-4ee6-9b9d-89b53e0de1e6 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:36.600710 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbad99-6297-46f1-9be8-3cf9c9ac4f9a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:36.647724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ae3c7-8c24-4990-a127-6e4f7873260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:36.648381 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ae3c7-8c24-4990-a127-6e4f7873260b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:36.648685 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ae3c7-8c24-4990-a127-6e4f7873260b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:36.648955 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ae3c7-8c24-4990-a127-6e4f7873260b None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:36.650107 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ae3c7-8c24-4990-a127-6e4f7873260b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:36.651027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ae3c7-8c24-4990-a127-6e4f7873260b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:36.652730 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ae3c7-8c24-4990-a127-6e4f7873260b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:36.658657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:36.672669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 430/869] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:36.677267 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ae3c7-8c24-4990-a127-6e4f7873260b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:36.684945 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e559e3-7ec9-4ee6-9b9d-89b53e0de1e6 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:36.724161 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bfa8c-93df-44ff-8287-62efafffc6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:36.724713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bfa8c-93df-44ff-8287-62efafffc6c9 None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:36.725108 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bfa8c-93df-44ff-8287-62efafffc6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:36.725386 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bfa8c-93df-44ff-8287-62efafffc6c9 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:36.726053 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bfa8c-93df-44ff-8287-62efafffc6c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:36.727481 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bfa8c-93df-44ff-8287-62efafffc6c9 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:36.742608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:36.752576 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 440/870] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Sep 25 00:42:36 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:42:36.789977 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb061-e4bd-4ad6-9022-319884e4ba4d None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:36.790289 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb061-e4bd-4ad6-9022-319884e4ba4d None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:36.790584 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb061-e4bd-4ad6-9022-319884e4ba4d None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:36.792754 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 441/871] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:42:36.798677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62743ba-5ae7-4125-a70c-17bb2047dbf1 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:36.798956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62743ba-5ae7-4125-a70c-17bb2047dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:36.799236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62743ba-5ae7-4125-a70c-17bb2047dbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:36.806100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ae3c7-8c24-4990-a127-6e4f7873260b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:36.820458 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-a62743ba-5ae7-4125-a70c-17bb2047dbf1 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:36.822164 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-a62743ba-5ae7-4125-a70c-17bb2047dbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:36.853183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773593-e036-48c1-afaa-d63fe675f34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:36.853872 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773593-e036-48c1-afaa-d63fe675f34f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:36.854150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773593-e036-48c1-afaa-d63fe675f34f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:36.854422 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773593-e036-48c1-afaa-d63fe675f34f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:36.862372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36773593-e036-48c1-afaa-d63fe675f34f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:36.863895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36773593-e036-48c1-afaa-d63fe675f34f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-36773593-e036-48c1-afaa-d63fe675f34f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:36.877003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:36.877953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:36.878819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:36.878819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:36.878819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:36.878819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:36.878819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:36.878819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:36.878819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:36.878819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:36.878819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 431/872] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:36.884665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773593-e036-48c1-afaa-d63fe675f34f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:36.910945 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 442/873] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:36.998939 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773593-e036-48c1-afaa-d63fe675f34f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:37.015595 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:37.035099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daec4b-06c6-41db-a667-ee7e39ec4460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:37.035712 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daec4b-06c6-41db-a667-ee7e39ec4460 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:37.035990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daec4b-06c6-41db-a667-ee7e39ec4460 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:37.036341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daec4b-06c6-41db-a667-ee7e39ec4460 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:37.037022 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6daec4b-06c6-41db-a667-ee7e39ec4460 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:37.037333 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6daec4b-06c6-41db-a667-ee7e39ec4460 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:37.038757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6daec4b-06c6-41db-a667-ee7e39ec4460 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:37.051905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 432/874] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:37.061676 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62743ba-5ae7-4125-a70c-17bb2047dbf1 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:37.138911 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:37.164984 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62743ba-5ae7-4125-a70c-17bb2047dbf1 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:37.190331 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daec4b-06c6-41db-a667-ee7e39ec4460 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:37.204793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac3d82-010d-4890-ad9e-3485c0790139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:37.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac3d82-010d-4890-ad9e-3485c0790139 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:37.205676 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac3d82-010d-4890-ad9e-3485c0790139 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:37.205946 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac3d82-010d-4890-ad9e-3485c0790139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:37.206674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac3d82-010d-4890-ad9e-3485c0790139 None admin] RBAC: Adding query filter params (role.id=e190761ca5494052a96426d0bd344261, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=6c53cca11c1c45a89651026d2ac75cc2) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:37.206977 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac3d82-010d-4890-ad9e-3485c0790139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:37.208402 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac3d82-010d-4890-ad9e-3485c0790139 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:37.220664 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 443/875] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:37 2022] GET /identity/v3/role_assignments?user.id=6c53cca11c1c45a89651026d2ac75cc2&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=e190761ca5494052a96426d0bd344261 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:37.310449 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daec4b-06c6-41db-a667-ee7e39ec4460 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:37.350020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969b45c-6645-4716-889f-1ad4c8ae1089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:37.350673 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969b45c-6645-4716-889f-1ad4c8ae1089 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:37.350952 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969b45c-6645-4716-889f-1ad4c8ae1089 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:37.351229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969b45c-6645-4716-889f-1ad4c8ae1089 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:37.351826 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969b45c-6645-4716-889f-1ad4c8ae1089 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:37.353240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969b45c-6645-4716-889f-1ad4c8ae1089 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-b969b45c-6645-4716-889f-1ad4c8ae1089 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:37.363338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:37.364481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:37.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:37.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:37.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:37.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:37.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:37.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:37.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:37.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:37.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:37.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:37.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:37.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:37.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:37.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:37.368590 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 433/876] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Sep 25 00:42:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:37.371197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac3d82-010d-4890-ad9e-3485c0790139 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:37.482205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac3d82-010d-4890-ad9e-3485c0790139 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:37.519741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7680b-cd4b-4fef-a90e-875040975b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:37.520785 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7680b-cd4b-4fef-a90e-875040975b7c None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:37.521300 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7680b-cd4b-4fef-a90e-875040975b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:37.521783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7680b-cd4b-4fef-a90e-875040975b7c None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:37.522636 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7680b-cd4b-4fef-a90e-875040975b7c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:37.523151 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7680b-cd4b-4fef-a90e-875040975b7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:37.524832 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7680b-cd4b-4fef-a90e-875040975b7c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:37.531565 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 444/877] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Sep 25 00:42:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:37.537319 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969b45c-6645-4716-889f-1ad4c8ae1089 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:37.584401 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:37.654701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969b45c-6645-4716-889f-1ad4c8ae1089 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:37.656163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f710e9-5168-4474-8651-5b8afe55c1d7 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:37.656449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f710e9-5168-4474-8651-5b8afe55c1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:37.656775 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f710e9-5168-4474-8651-5b8afe55c1d7 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:37.658412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 445/878] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:37.663365 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63666973-3969-4f58-b6ad-774d33c5e8eb None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:37.663653 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63666973-3969-4f58-b6ad-774d33c5e8eb None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:37.663935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63666973-3969-4f58-b6ad-774d33c5e8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:37.670251 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:37.683435 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-63666973-3969-4f58-b6ad-774d33c5e8eb None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:37.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-63666973-3969-4f58-b6ad-774d33c5e8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:37.695375 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8918e2-6e53-4305-a6ec-1c1da9802868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:37.695995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8918e2-6e53-4305-a6ec-1c1da9802868 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:37.696273 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8918e2-6e53-4305-a6ec-1c1da9802868 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:37.696561 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8918e2-6e53-4305-a6ec-1c1da9802868 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:37.698172 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8918e2-6e53-4305-a6ec-1c1da9802868 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:37.698748 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8918e2-6e53-4305-a6ec-1c1da9802868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:37.700235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8918e2-6e53-4305-a6ec-1c1da9802868 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:37.705885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 434/879] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Sep 25 00:42:37 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:37.764380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 446/880] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:37 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:38.033129 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8918e2-6e53-4305-a6ec-1c1da9802868 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:38.136635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8918e2-6e53-4305-a6ec-1c1da9802868 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:38.139038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:38.172748 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6f2ae-a578-435e-a6b0-4a6b60ba2c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:38.174111 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6f2ae-a578-435e-a6b0-4a6b60ba2c06 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:38.174111 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6f2ae-a578-435e-a6b0-4a6b60ba2c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:38.174111 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6f2ae-a578-435e-a6b0-4a6b60ba2c06 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:38.174550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6f2ae-a578-435e-a6b0-4a6b60ba2c06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:38.175937 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6f2ae-a578-435e-a6b0-4a6b60ba2c06 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:38.195406 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 435/881] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Sep 25 00:42:38 2022] POST /identity/v3/services => generated 269 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:42:39.070457 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2040a1-373a-4f79-854e-a40cbe0278b1 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:39.070987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2040a1-373a-4f79-854e-a40cbe0278b1 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:39.070987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2040a1-373a-4f79-854e-a40cbe0278b1 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:39.073193 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 447/882] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:39.078646 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84b6e5-cd72-4db0-b48c-0b5d049f7fc7 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:39.079063 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84b6e5-cd72-4db0-b48c-0b5d049f7fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:39.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84b6e5-cd72-4db0-b48c-0b5d049f7fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:39.097313 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-9f84b6e5-cd72-4db0-b48c-0b5d049f7fc7 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:39.098508 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-9f84b6e5-cd72-4db0-b48c-0b5d049f7fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:39.176664 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 436/883] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:39.440582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2040a1-373a-4f79-854e-a40cbe0278b1 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:39.549862 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2040a1-373a-4f79-854e-a40cbe0278b1 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:39.583096 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:39.589219 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb2b68-8807-4a4e-8ff6-6930f5af0a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:39.589790 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb2b68-8807-4a4e-8ff6-6930f5af0a24 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:39.590365 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb2b68-8807-4a4e-8ff6-6930f5af0a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:39.590638 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb2b68-8807-4a4e-8ff6-6930f5af0a24 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:39.591226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb2b68-8807-4a4e-8ff6-6930f5af0a24 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:39.592624 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb2b68-8807-4a4e-8ff6-6930f5af0a24 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-0bbb2b68-8807-4a4e-8ff6-6930f5af0a24 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:39.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:39.603755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:39.604631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:39.604631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:39.604631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:39.604631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:39.604631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:39.604631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:39.604631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:39.604631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:39.604631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:39.604631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:39.604631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:39.604631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:39.604631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:42:39.604631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:39.608732 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 448/884] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:42:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:39.610096 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84b6e5-cd72-4db0-b48c-0b5d049f7fc7 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:39.676308 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099246d-0675-497a-b761-298cf8e68057 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:39.676986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099246d-0675-497a-b761-298cf8e68057 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:39.677469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099246d-0675-497a-b761-298cf8e68057 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:39.679462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 449/885] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:42:39.686529 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4e460-055b-4c67-8473-595449959d6f None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:39.687056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4e460-055b-4c67-8473-595449959d6f None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:39.687554 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4e460-055b-4c67-8473-595449959d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:39.706719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-ebc4e460-055b-4c67-8473-595449959d6f None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:39.708174 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-ebc4e460-055b-4c67-8473-595449959d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:39.708903 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:39.717280 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84b6e5-cd72-4db0-b48c-0b5d049f7fc7 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:39.760126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f09b63-7eb2-4aa2-946c-cfb44964f5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:39.760838 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09b63-7eb2-4aa2-946c-cfb44964f5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:39.761119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09b63-7eb2-4aa2-946c-cfb44964f5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:39.761394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09b63-7eb2-4aa2-946c-cfb44964f5c5 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:39.762022 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f09b63-7eb2-4aa2-946c-cfb44964f5c5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:39.762509 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f09b63-7eb2-4aa2-946c-cfb44964f5c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:39.764689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f09b63-7eb2-4aa2-946c-cfb44964f5c5 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:39.770894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 437/886] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:42:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:39.778609 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f09b63-7eb2-4aa2-946c-cfb44964f5c5 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:39.800371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 450/887] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:39.892743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f09b63-7eb2-4aa2-946c-cfb44964f5c5 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:39.902166 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb3ca8-a23d-45e9-bbec-1d678650507a None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:39.902770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb3ca8-a23d-45e9-bbec-1d678650507a None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:39.903562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb3ca8-a23d-45e9-bbec-1d678650507a None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:39.906253 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 451/888] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:42:39.914198 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1717d-20f4-4598-9c1d-484c1b1029fe None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:39.914489 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1717d-20f4-4598-9c1d-484c1b1029fe None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:39.915040 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1717d-20f4-4598-9c1d-484c1b1029fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:39.936329 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-8fe1717d-20f4-4598-9c1d-484c1b1029fe None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:39.937734 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621242e-2bc5-4b74-8e79-c08cf811d668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:39.938062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-8fe1717d-20f4-4598-9c1d-484c1b1029fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:39.938348 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621242e-2bc5-4b74-8e79-c08cf811d668 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:39.938629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621242e-2bc5-4b74-8e79-c08cf811d668 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:39.938905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621242e-2bc5-4b74-8e79-c08cf811d668 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:39.939540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621242e-2bc5-4b74-8e79-c08cf811d668 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:39.939903 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621242e-2bc5-4b74-8e79-c08cf811d668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:39.941312 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621242e-2bc5-4b74-8e79-c08cf811d668 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:39.946938 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 438/889] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:42:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:39.954217 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621242e-2bc5-4b74-8e79-c08cf811d668 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:39.983988 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:40.020164 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 452/890] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:40.075360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621242e-2bc5-4b74-8e79-c08cf811d668 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:40.096119 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1717d-20f4-4598-9c1d-484c1b1029fe None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:40.112120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd4665-3331-4a02-958e-3911519e6567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:40.112755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4665-3331-4a02-958e-3911519e6567 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:40.113033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4665-3331-4a02-958e-3911519e6567 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:40.113304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4665-3331-4a02-958e-3911519e6567 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:40.114002 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd4665-3331-4a02-958e-3911519e6567 None admin] RBAC: Adding query filter params (interface=public, service_id=97cf779bd60743edb45f94ceff602696, region_id=RegionOne) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:40.114679 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd4665-3331-4a02-958e-3911519e6567 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:40.116305 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd4665-3331-4a02-958e-3911519e6567 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:40.124633 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 439/891] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Sep 25 00:42:39 2022] GET /identity/v3/endpoints?service_id=97cf779bd60743edb45f94ceff602696&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:40.129475 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd4665-3331-4a02-958e-3911519e6567 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:40.175663 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:40.227905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:40.234522 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1717d-20f4-4598-9c1d-484c1b1029fe None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:40.254342 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd4665-3331-4a02-958e-3911519e6567 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:40.271640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccc9d7-6ba2-49ef-bbf0-daf6404c4926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:40.272610 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccc9d7-6ba2-49ef-bbf0-daf6404c4926 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:40.273047 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccc9d7-6ba2-49ef-bbf0-daf6404c4926 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:40.273532 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccc9d7-6ba2-49ef-bbf0-daf6404c4926 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:40.284339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccc9d7-6ba2-49ef-bbf0-daf6404c4926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-94ccc9d7-6ba2-49ef-bbf0-daf6404c4926 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:40.289783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:40.291429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:40.292417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:40.292417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:40.292417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:40.292417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:40.292417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:40.292417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:40.292417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:40.292417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:40.292417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:40.292417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:40.292417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:42:40.292417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:40.294505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 453/892] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Sep 25 00:42:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:40.299439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce6366-c7cd-4fa1-9849-fbe8dbf5b067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:40.299439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce6366-c7cd-4fa1-9849-fbe8dbf5b067 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:40.299439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce6366-c7cd-4fa1-9849-fbe8dbf5b067 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:40.299439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce6366-c7cd-4fa1-9849-fbe8dbf5b067 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:40.299779 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccc9d7-6ba2-49ef-bbf0-daf6404c4926 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:40.299863 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce6366-c7cd-4fa1-9849-fbe8dbf5b067 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:40.299863 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce6366-c7cd-4fa1-9849-fbe8dbf5b067 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:40.313035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 440/893] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Sep 25 00:42:40 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:42:40.315032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce6366-c7cd-4fa1-9849-fbe8dbf5b067 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:40.417846 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccc9d7-6ba2-49ef-bbf0-daf6404c4926 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:40.436757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:40.449568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce6366-c7cd-4fa1-9849-fbe8dbf5b067 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:40.457927 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1045a-8572-4636-a633-7ae3732509ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:40.458547 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1045a-8572-4636-a633-7ae3732509ce None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:40.458952 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1045a-8572-4636-a633-7ae3732509ce None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:40.459227 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1045a-8572-4636-a633-7ae3732509ce None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:40.459903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1045a-8572-4636-a633-7ae3732509ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:40.461451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1045a-8572-4636-a633-7ae3732509ce None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:40.480594 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 454/894] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Sep 25 00:42:40 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:42:40.482754 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb60b3-eb78-44fb-b37c-d97f3c9c1ee2 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:40.483041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb60b3-eb78-44fb-b37c-d97f3c9c1ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:40.483314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb60b3-eb78-44fb-b37c-d97f3c9c1ee2 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:40.488932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 455/895] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:40.491278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79a771-a081-4232-a2f3-86bc587b4c44 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:40.491563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79a771-a081-4232-a2f3-86bc587b4c44 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:40.491841 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79a771-a081-4232-a2f3-86bc587b4c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:40.510476 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e337ac-e4fc-4854-8742-e112d225d09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:40.511098 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e337ac-e4fc-4854-8742-e112d225d09f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:40.511375 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e337ac-e4fc-4854-8742-e112d225d09f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:40.511642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e337ac-e4fc-4854-8742-e112d225d09f None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:40.512309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e337ac-e4fc-4854-8742-e112d225d09f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:40.514565 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e337ac-e4fc-4854-8742-e112d225d09f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:40.514723 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-6d79a771-a081-4232-a2f3-86bc587b4c44 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:40.514813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e337ac-e4fc-4854-8742-e112d225d09f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:40.514898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-6d79a771-a081-4232-a2f3-86bc587b4c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:40.524071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 441/896] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Sep 25 00:42:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:40.531287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e337ac-e4fc-4854-8742-e112d225d09f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:40.535703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:40.602882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 456/897] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:40.671419 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e337ac-e4fc-4854-8742-e112d225d09f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:40.706890 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e8336-d531-4a6b-aed8-b68640924844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:40.707526 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8336-d531-4a6b-aed8-b68640924844 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:40.707801 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8336-d531-4a6b-aed8-b68640924844 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:40.708068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8336-d531-4a6b-aed8-b68640924844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:40.719897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e8336-d531-4a6b-aed8-b68640924844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:40.721462 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e8336-d531-4a6b-aed8-b68640924844 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-504e8336-d531-4a6b-aed8-b68640924844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:40.736858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:40.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:40.739969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:40.739969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:40.739969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:40.739969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 442/898] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:40.744164 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79a771-a081-4232-a2f3-86bc587b4c44 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:40.851015 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79a771-a081-4232-a2f3-86bc587b4c44 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:40.859286 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:40.890564 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fb56b-8bcf-4c8d-8d5a-32621a546d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:40.891169 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fb56b-8bcf-4c8d-8d5a-32621a546d1d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:40.891443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fb56b-8bcf-4c8d-8d5a-32621a546d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:40.891714 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fb56b-8bcf-4c8d-8d5a-32621a546d1d None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:40.892354 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fb56b-8bcf-4c8d-8d5a-32621a546d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:40.892683 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fb56b-8bcf-4c8d-8d5a-32621a546d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:40.894048 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fb56b-8bcf-4c8d-8d5a-32621a546d1d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:40.896926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e8336-d531-4a6b-aed8-b68640924844 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:40.910038 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 457/899] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:40.915379 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fb56b-8bcf-4c8d-8d5a-32621a546d1d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:40.958070 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:41.014567 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e8336-d531-4a6b-aed8-b68640924844 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:41.023546 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fb56b-8bcf-4c8d-8d5a-32621a546d1d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:41.055618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66924c93-8550-4121-a258-222128004e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:41.056255 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66924c93-8550-4121-a258-222128004e5a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:41.056537 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66924c93-8550-4121-a258-222128004e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:41.056840 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66924c93-8550-4121-a258-222128004e5a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:41.057474 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66924c93-8550-4121-a258-222128004e5a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:41.059142 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66924c93-8550-4121-a258-222128004e5a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:41.060842 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e439c-ade8-4e6c-9d77-b054858e82f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:41.061917 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e439c-ade8-4e6c-9d77-b054858e82f8 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:41.062436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e439c-ade8-4e6c-9d77-b054858e82f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:41.062921 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e439c-ade8-4e6c-9d77-b054858e82f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-66924c93-8550-4121-a258-222128004e5a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:41.069576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:41.070783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:41.071738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 443/900] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Sep 25 00:42:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:41.074419 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e439c-ade8-4e6c-9d77-b054858e82f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:41.075863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e439c-ade8-4e6c-9d77-b054858e82f8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:41.077209 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66924c93-8550-4121-a258-222128004e5a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-ba7e439c-ade8-4e6c-9d77-b054858e82f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:41.092205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:41.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:41.094317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:41.094317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:41.094317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:41.094317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:41.094317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:41.094317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:41.094317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:41.094317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:41.094317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:42:41.094317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:41.096657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 458/901] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Sep 25 00:42:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:41.099333 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e439c-ade8-4e6c-9d77-b054858e82f8 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:41.136445 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:41.194108 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66924c93-8550-4121-a258-222128004e5a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:41.218815 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:41.233180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e439c-ade8-4e6c-9d77-b054858e82f8 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:41.235696 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63582801-af20-450f-b530-5f3826e32365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:41.237227 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63582801-af20-450f-b530-5f3826e32365 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:41.237582 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63582801-af20-450f-b530-5f3826e32365 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:41.237932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63582801-af20-450f-b530-5f3826e32365 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:41.238637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63582801-af20-450f-b530-5f3826e32365 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:41.239004 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63582801-af20-450f-b530-5f3826e32365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:41.240527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63582801-af20-450f-b530-5f3826e32365 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:41.247136 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 444/902] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Sep 25 00:42:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:41.252177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63582801-af20-450f-b530-5f3826e32365 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:41.276251 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa085f1-12b7-4b3a-b42c-57d9c1811017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:41.276808 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa085f1-12b7-4b3a-b42c-57d9c1811017 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:41.277086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa085f1-12b7-4b3a-b42c-57d9c1811017 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:41.277356 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa085f1-12b7-4b3a-b42c-57d9c1811017 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:41.278088 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa085f1-12b7-4b3a-b42c-57d9c1811017 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:41.278389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa085f1-12b7-4b3a-b42c-57d9c1811017 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:41.279803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa085f1-12b7-4b3a-b42c-57d9c1811017 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:41.303147 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 459/903] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Sep 25 00:42:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:41.303570 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa085f1-12b7-4b3a-b42c-57d9c1811017 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:41.385010 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63582801-af20-450f-b530-5f3826e32365 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:41.414483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:41.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a1fb-a8f0-439f-b455-5ce2783c3122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:41.426043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a1fb-a8f0-439f-b455-5ce2783c3122 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:41.426328 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a1fb-a8f0-439f-b455-5ce2783c3122 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:41.426597 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a1fb-a8f0-439f-b455-5ce2783c3122 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:41.427405 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a1fb-a8f0-439f-b455-5ce2783c3122 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:41.427707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a1fb-a8f0-439f-b455-5ce2783c3122 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:41.429827 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a1fb-a8f0-439f-b455-5ce2783c3122 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:41.440660 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 445/904] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Sep 25 00:42:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:41.441863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa085f1-12b7-4b3a-b42c-57d9c1811017 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:41.443121 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a1fb-a8f0-439f-b455-5ce2783c3122 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:41.488744 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd66bac-fa88-46bb-bb57-158e129d8c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:41.489916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd66bac-fa88-46bb-bb57-158e129d8c15 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:41.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd66bac-fa88-46bb-bb57-158e129d8c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:41.491357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd66bac-fa88-46bb-bb57-158e129d8c15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:41.493399 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:41.550551 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a1fb-a8f0-439f-b455-5ce2783c3122 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:41.583877 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd66bac-fa88-46bb-bb57-158e129d8c15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:41.585474 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd66bac-fa88-46bb-bb57-158e129d8c15 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:41.593765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b7ef4-93ea-46e1-bead-9d50204b5d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:41.594601 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b7ef4-93ea-46e1-bead-9d50204b5d32 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:41.594728 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b7ef4-93ea-46e1-bead-9d50204b5d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:41.594890 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b7ef4-93ea-46e1-bead-9d50204b5d32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:41.595739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b7ef4-93ea-46e1-bead-9d50204b5d32 None admin] RBAC: Adding query filter params (interface=public, service_id=7febdac0d48d4bd59c986c1b551ed8c5, region_id=RegionOne) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:41.596052 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b7ef4-93ea-46e1-bead-9d50204b5d32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:41.597521 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b7ef4-93ea-46e1-bead-9d50204b5d32 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:41.607317 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 446/905] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Sep 25 00:42:41 2022] GET /identity/v3/endpoints?service_id=7febdac0d48d4bd59c986c1b551ed8c5&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:41.608577 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b7ef4-93ea-46e1-bead-9d50204b5d32 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:41.677427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:41.701009 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 460/906] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:42:41 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 00:42:41.702501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd66bac-fa88-46bb-bb57-158e129d8c15 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:41.749435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b7ef4-93ea-46e1-bead-9d50204b5d32 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:41.765677 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:41.792997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4cae5-8315-45fc-a24c-0d46f795597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:41.794064 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4cae5-8315-45fc-a24c-0d46f795597b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:41.794565 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4cae5-8315-45fc-a24c-0d46f795597b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:41.795040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4cae5-8315-45fc-a24c-0d46f795597b None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:41.795852 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4cae5-8315-45fc-a24c-0d46f795597b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:41.797474 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4cae5-8315-45fc-a24c-0d46f795597b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:41.805441 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 447/907] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Sep 25 00:42:41 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:42:41.841025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd66bac-fa88-46bb-bb57-158e129d8c15 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:41.880724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2b1a8-f410-4557-97f0-f0667d565128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:41.881694 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b1a8-f410-4557-97f0-f0667d565128 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:41.882149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b1a8-f410-4557-97f0-f0667d565128 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:41.882622 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b1a8-f410-4557-97f0-f0667d565128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:41.894614 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2b1a8-f410-4557-97f0-f0667d565128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:41.896529 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2b1a8-f410-4557-97f0-f0667d565128 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-2cf2b1a8-f410-4557-97f0-f0667d565128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:41.912858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:41.913905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:41.914776 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:41.914776 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:41.914776 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:41.917444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 461/908] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:41.923434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4cae5-8315-45fc-a24c-0d46f795597b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:42.035740 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4cae5-8315-45fc-a24c-0d46f795597b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:42.071702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd2f79-67e5-48ab-920e-d67a70eec709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:42.072707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd2f79-67e5-48ab-920e-d67a70eec709 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:42.073210 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd2f79-67e5-48ab-920e-d67a70eec709 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:42.073712 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd2f79-67e5-48ab-920e-d67a70eec709 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:42.074557 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd2f79-67e5-48ab-920e-d67a70eec709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:42.075069 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd2f79-67e5-48ab-920e-d67a70eec709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:42.076661 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd2f79-67e5-48ab-920e-d67a70eec709 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:42.089301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 448/909] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:42.095147 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2b1a8-f410-4557-97f0-f0667d565128 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:42.132227 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:42.206197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2b1a8-f410-4557-97f0-f0667d565128 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:42.242826 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0a654-8c54-4621-8ca8-f7d1b27540fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:42.244013 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0a654-8c54-4621-8ca8-f7d1b27540fc None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:42.244493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0a654-8c54-4621-8ca8-f7d1b27540fc None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:42.245019 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0a654-8c54-4621-8ca8-f7d1b27540fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:42.252284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0a654-8c54-4621-8ca8-f7d1b27540fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:42.254099 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0a654-8c54-4621-8ca8-f7d1b27540fc None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-fdd0a654-8c54-4621-8ca8-f7d1b27540fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:42.266018 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:42.266912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:42.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:42.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:42.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:42.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:42.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:42.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:42.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:42.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:42.270262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 462/910] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:42.276694 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd2f79-67e5-48ab-920e-d67a70eec709 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:42.313837 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:42.381940 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd2f79-67e5-48ab-920e-d67a70eec709 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:42.416530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69304b7-8d55-42e1-bacd-0055607b44e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:42.417576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69304b7-8d55-42e1-bacd-0055607b44e6 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:42.418074 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69304b7-8d55-42e1-bacd-0055607b44e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:42.418546 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69304b7-8d55-42e1-bacd-0055607b44e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:42.419453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69304b7-8d55-42e1-bacd-0055607b44e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:42.419957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69304b7-8d55-42e1-bacd-0055607b44e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:42.421635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69304b7-8d55-42e1-bacd-0055607b44e6 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:42.438991 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 449/911] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:42.445222 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0a654-8c54-4621-8ca8-f7d1b27540fc None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:42.551475 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:42.558756 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0a654-8c54-4621-8ca8-f7d1b27540fc None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:42.596837 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfaf64-5041-46a5-a055-b96beec47edf None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:42.597178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfaf64-5041-46a5-a055-b96beec47edf None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:42.597284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351e9f4-f2b7-46da-8fe8-05e9b9f323b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:42.597385 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfaf64-5041-46a5-a055-b96beec47edf None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:42.597890 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351e9f4-f2b7-46da-8fe8-05e9b9f323b1 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:42.598171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351e9f4-f2b7-46da-8fe8-05e9b9f323b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:42.598450 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351e9f4-f2b7-46da-8fe8-05e9b9f323b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:42.599015 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 450/912] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:42.599228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351e9f4-f2b7-46da-8fe8-05e9b9f323b1 None admin] RBAC: Adding query filter params (role.id=01d4be0e55534d58aea1a76f9441d7f4, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=6c53cca11c1c45a89651026d2ac75cc2) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:42.599503 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351e9f4-f2b7-46da-8fe8-05e9b9f323b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:42.601032 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351e9f4-f2b7-46da-8fe8-05e9b9f323b1 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:42.604892 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960929-0819-4ad3-97e8-46072384c2fe None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:42.605179 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960929-0819-4ad3-97e8-46072384c2fe None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:42.605459 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960929-0819-4ad3-97e8-46072384c2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:42.607402 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 463/913] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:42 2022] GET /identity/v3/role_assignments?user.id=6c53cca11c1c45a89651026d2ac75cc2&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=01d4be0e55534d58aea1a76f9441d7f4 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:42.630117 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-2a960929-0819-4ad3-97e8-46072384c2fe None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:42.631619 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-2a960929-0819-4ad3-97e8-46072384c2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:42.709075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 451/914] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:42.724164 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98210d-ea8b-4450-a6e9-87e8b44a79ff None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:42.724536 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98210d-ea8b-4450-a6e9-87e8b44a79ff None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:42.724774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98210d-ea8b-4450-a6e9-87e8b44a79ff None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:42.726419 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 464/915] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:42.732211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539cad-4841-46af-a30a-e073cc8432e9 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:42.732493 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539cad-4841-46af-a30a-e073cc8432e9 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:42.732817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539cad-4841-46af-a30a-e073cc8432e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:42.752129 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-5c539cad-4841-46af-a30a-e073cc8432e9 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:42.753390 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-5c539cad-4841-46af-a30a-e073cc8432e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:42.776877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:42.842134 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 452/916] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:42.981524 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98210d-ea8b-4450-a6e9-87e8b44a79ff None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:43.092576 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98210d-ea8b-4450-a6e9-87e8b44a79ff None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:43.113798 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c539cad-4841-46af-a30a-e073cc8432e9 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:43.132276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82bf1d-00e2-4050-b1fd-623abc4df1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:43.133037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82bf1d-00e2-4050-b1fd-623abc4df1fe None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:43.133313 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82bf1d-00e2-4050-b1fd-623abc4df1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:43.133582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82bf1d-00e2-4050-b1fd-623abc4df1fe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:43.134735 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82bf1d-00e2-4050-b1fd-623abc4df1fe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:43.136206 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82bf1d-00e2-4050-b1fd-623abc4df1fe None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-7e82bf1d-00e2-4050-b1fd-623abc4df1fe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:43.145882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:43.146855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:43.147671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 465/917] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:42:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:43.155100 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82bf1d-00e2-4050-b1fd-623abc4df1fe None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:43.188932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:43.217390 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c539cad-4841-46af-a30a-e073cc8432e9 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:43.252621 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca9b03-921f-4857-a317-0ef8664d0785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:43.253206 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca9b03-921f-4857-a317-0ef8664d0785 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:43.253487 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca9b03-921f-4857-a317-0ef8664d0785 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:43.253758 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca9b03-921f-4857-a317-0ef8664d0785 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:43.254351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca9b03-921f-4857-a317-0ef8664d0785 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:43.255735 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca9b03-921f-4857-a317-0ef8664d0785 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-1dca9b03-921f-4857-a317-0ef8664d0785 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:43.264858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:43.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:43.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:43.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:43.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:43.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:43.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:43.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:43.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:43.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:43.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:43.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:43.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:43.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:43.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:43.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:43.270279 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82bf1d-00e2-4050-b1fd-623abc4df1fe None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:43.270941 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 453/918] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Sep 25 00:42:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:43.271825 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca9b03-921f-4857-a317-0ef8664d0785 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:43.294268 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:43.311470 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48539b41-c8c1-4c2b-90ab-ce40cd40c32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:43.312489 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48539b41-c8c1-4c2b-90ab-ce40cd40c32d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:43.313214 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48539b41-c8c1-4c2b-90ab-ce40cd40c32d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:43.313683 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48539b41-c8c1-4c2b-90ab-ce40cd40c32d None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:43.314560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48539b41-c8c1-4c2b-90ab-ce40cd40c32d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:43.315156 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48539b41-c8c1-4c2b-90ab-ce40cd40c32d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:43.316848 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48539b41-c8c1-4c2b-90ab-ce40cd40c32d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:43.327362 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 466/919] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:42:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:43.328664 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48539b41-c8c1-4c2b-90ab-ce40cd40c32d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:43.375088 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca9b03-921f-4857-a317-0ef8664d0785 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:43.417529 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0eae-4797-42bf-b9d9-0ecbebce4765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:43.418153 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0eae-4797-42bf-b9d9-0ecbebce4765 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:43.418430 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0eae-4797-42bf-b9d9-0ecbebce4765 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:43.418703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0eae-4797-42bf-b9d9-0ecbebce4765 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:43.419632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc0eae-4797-42bf-b9d9-0ecbebce4765 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:43.419943 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc0eae-4797-42bf-b9d9-0ecbebce4765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:43.421812 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc0eae-4797-42bf-b9d9-0ecbebce4765 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:43.423682 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:43.433604 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 454/920] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Sep 25 00:42:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:43.435801 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0eae-4797-42bf-b9d9-0ecbebce4765 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:43.442415 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48539b41-c8c1-4c2b-90ab-ce40cd40c32d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:43.478679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd222ff5-1f2a-4886-8c41-80d992286410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:43.479200 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222ff5-1f2a-4886-8c41-80d992286410 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:43.479525 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222ff5-1f2a-4886-8c41-80d992286410 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:43.479802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222ff5-1f2a-4886-8c41-80d992286410 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:43.480428 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd222ff5-1f2a-4886-8c41-80d992286410 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:43.480771 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd222ff5-1f2a-4886-8c41-80d992286410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:43.482196 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd222ff5-1f2a-4886-8c41-80d992286410 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:43.487749 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 467/921] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Sep 25 00:42:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:43.494037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd222ff5-1f2a-4886-8c41-80d992286410 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:43.537374 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:43.555927 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0eae-4797-42bf-b9d9-0ecbebce4765 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:43.596924 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c603fb-2e47-4611-ba82-a18079c6ab41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:43.597781 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c603fb-2e47-4611-ba82-a18079c6ab41 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:43.598210 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c603fb-2e47-4611-ba82-a18079c6ab41 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:43.598639 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c603fb-2e47-4611-ba82-a18079c6ab41 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:43.599685 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c603fb-2e47-4611-ba82-a18079c6ab41 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:43.600565 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c603fb-2e47-4611-ba82-a18079c6ab41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:43.602483 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c603fb-2e47-4611-ba82-a18079c6ab41 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:43.606618 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd222ff5-1f2a-4886-8c41-80d992286410 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:43.613960 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 455/922] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Sep 25 00:42:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:43.615558 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c603fb-2e47-4611-ba82-a18079c6ab41 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:43.647812 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484be96b-5d40-4ef3-91db-f27e7063c053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:43.648475 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484be96b-5d40-4ef3-91db-f27e7063c053 None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:43.648780 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484be96b-5d40-4ef3-91db-f27e7063c053 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:43.649051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484be96b-5d40-4ef3-91db-f27e7063c053 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:43.650474 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484be96b-5d40-4ef3-91db-f27e7063c053 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:43.651940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484be96b-5d40-4ef3-91db-f27e7063c053 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:43.680966 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 468/923] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Sep 25 00:42:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:42:43.734271 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c603fb-2e47-4611-ba82-a18079c6ab41 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:43.779280 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10261c60-4a35-4c33-92c7-612d342f0e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:43.780330 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10261c60-4a35-4c33-92c7-612d342f0e6f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:43.780872 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10261c60-4a35-4c33-92c7-612d342f0e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:43.781388 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10261c60-4a35-4c33-92c7-612d342f0e6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:43.782356 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10261c60-4a35-4c33-92c7-612d342f0e6f None admin] RBAC: Adding query filter params (interface=public, service_id=82afdb5620a4425e8637de3c43aab126, region_id=RegionOne) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:43.782871 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10261c60-4a35-4c33-92c7-612d342f0e6f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:43.784456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10261c60-4a35-4c33-92c7-612d342f0e6f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:43.791675 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 456/924] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Sep 25 00:42:43 2022] GET /identity/v3/endpoints?service_id=82afdb5620a4425e8637de3c43aab126&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:43.797910 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484be96b-5d40-4ef3-91db-f27e7063c053 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:43.812510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:43.916173 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484be96b-5d40-4ef3-91db-f27e7063c053 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:43.953600 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a64085-ae91-4b97-b315-08cac2527932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:43.954211 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a64085-ae91-4b97-b315-08cac2527932 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:43.954485 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a64085-ae91-4b97-b315-08cac2527932 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:43.954750 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a64085-ae91-4b97-b315-08cac2527932 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:43.955362 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a64085-ae91-4b97-b315-08cac2527932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:43.956743 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a64085-ae91-4b97-b315-08cac2527932 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:43.963689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 469/925] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Sep 25 00:42:43 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:42:44.265057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daa09d-2d99-4ade-a409-7f7cbbebfc55 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:44.265432 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daa09d-2d99-4ade-a409-7f7cbbebfc55 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:44.265611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daa09d-2d99-4ade-a409-7f7cbbebfc55 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:44.267071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 457/926] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:44.272336 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2dcfd-f8a8-4ada-b0d2-51c4f7c05535 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:44.273241 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2dcfd-f8a8-4ada-b0d2-51c4f7c05535 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:44.273732 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2dcfd-f8a8-4ada-b0d2-51c4f7c05535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:44.293142 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-6fc2dcfd-f8a8-4ada-b0d2-51c4f7c05535 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:44.294665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-6fc2dcfd-f8a8-4ada-b0d2-51c4f7c05535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:44.370142 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 470/927] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:44.646553 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59daa09d-2d99-4ade-a409-7f7cbbebfc55 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:44.660010 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:44.767189 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59daa09d-2d99-4ade-a409-7f7cbbebfc55 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:44.801438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2418705-69e3-4678-8c82-3d2b3aa6e4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:44.802073 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2418705-69e3-4678-8c82-3d2b3aa6e4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:44.802352 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2418705-69e3-4678-8c82-3d2b3aa6e4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:44.802625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2418705-69e3-4678-8c82-3d2b3aa6e4b0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:44.803209 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2418705-69e3-4678-8c82-3d2b3aa6e4b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:44.804580 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2418705-69e3-4678-8c82-3d2b3aa6e4b0 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-f2418705-69e3-4678-8c82-3d2b3aa6e4b0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:44.814086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:44.815047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:44.815934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 458/928] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Sep 25 00:42:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:44.819253 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d91d1-32ea-44f5-bed1-2ce69766129e None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:44.819790 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d91d1-32ea-44f5-bed1-2ce69766129e None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:44.820089 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d91d1-32ea-44f5-bed1-2ce69766129e None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:44.825255 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2418705-69e3-4678-8c82-3d2b3aa6e4b0 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:44.830735 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 471/929] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:44.832354 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b58b9-3c67-4fd8-9dda-2dfc22297da9 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:44.832662 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b58b9-3c67-4fd8-9dda-2dfc22297da9 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:44.832939 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b58b9-3c67-4fd8-9dda-2dfc22297da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:44.839815 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:44.855364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-d13b58b9-3c67-4fd8-9dda-2dfc22297da9 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:44.856873 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-d13b58b9-3c67-4fd8-9dda-2dfc22297da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:44.912884 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:44.950050 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 472/930] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:44.956596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2418705-69e3-4678-8c82-3d2b3aa6e4b0 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:44.989179 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685a497-7a8f-4a63-96c3-9a2307c0297a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:44.989784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685a497-7a8f-4a63-96c3-9a2307c0297a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:44.990060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685a497-7a8f-4a63-96c3-9a2307c0297a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:44.990329 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685a497-7a8f-4a63-96c3-9a2307c0297a None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:44.990949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685a497-7a8f-4a63-96c3-9a2307c0297a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:44.991246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685a497-7a8f-4a63-96c3-9a2307c0297a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:44.992702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685a497-7a8f-4a63-96c3-9a2307c0297a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:44.998473 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 459/931] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Sep 25 00:42:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:45.009828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b58b9-3c67-4fd8-9dda-2dfc22297da9 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:45.118813 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b58b9-3c67-4fd8-9dda-2dfc22297da9 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:45.148490 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:45.154477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595fbd5-08cb-4b0c-b53c-df005b03b313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:45.155093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595fbd5-08cb-4b0c-b53c-df005b03b313 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:45.155368 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595fbd5-08cb-4b0c-b53c-df005b03b313 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:45.155692 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595fbd5-08cb-4b0c-b53c-df005b03b313 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:45.156323 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595fbd5-08cb-4b0c-b53c-df005b03b313 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:45.156681 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595fbd5-08cb-4b0c-b53c-df005b03b313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:45.158045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595fbd5-08cb-4b0c-b53c-df005b03b313 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:45.163302 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 473/932] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Sep 25 00:42:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:45.169616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685a497-7a8f-4a63-96c3-9a2307c0297a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:45.256128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595fbd5-08cb-4b0c-b53c-df005b03b313 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:45.280005 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685a497-7a8f-4a63-96c3-9a2307c0297a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:45.324765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc09e1-1a87-4ed8-8cb2-3db134d1abbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:45.325381 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc09e1-1a87-4ed8-8cb2-3db134d1abbb None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:45.325656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc09e1-1a87-4ed8-8cb2-3db134d1abbb None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:45.325928 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc09e1-1a87-4ed8-8cb2-3db134d1abbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:45.326860 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc09e1-1a87-4ed8-8cb2-3db134d1abbb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:45.328844 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc09e1-1a87-4ed8-8cb2-3db134d1abbb None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:45.335811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:45.360573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 460/933] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Sep 25 00:42:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:42:45.371002 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595fbd5-08cb-4b0c-b53c-df005b03b313 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:45.418303 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0dd5d-cde6-403f-ba3d-152a4e9840d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:45.418870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0dd5d-cde6-403f-ba3d-152a4e9840d3 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:45.419146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0dd5d-cde6-403f-ba3d-152a4e9840d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:45.419416 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0dd5d-cde6-403f-ba3d-152a4e9840d3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:45.431525 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0dd5d-cde6-403f-ba3d-152a4e9840d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-11c0dd5d-cde6-403f-ba3d-152a4e9840d3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:45.438082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:45.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:45.440396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:45.440396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:45.440396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:45.440396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:45.440396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:45.440396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:45.440396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:45.440396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:45.440396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:45.440396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:45.440396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:42:45.440396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:45.440396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 474/934] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Sep 25 00:42:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:45.444278 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc09e1-1a87-4ed8-8cb2-3db134d1abbb None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:45.560320 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc09e1-1a87-4ed8-8cb2-3db134d1abbb None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:45.595799 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d885ad5-234b-4043-a9eb-d402aaf242b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:45.596412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d885ad5-234b-4043-a9eb-d402aaf242b1 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:45.596719 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d885ad5-234b-4043-a9eb-d402aaf242b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:45.596987 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d885ad5-234b-4043-a9eb-d402aaf242b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:45.597706 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d885ad5-234b-4043-a9eb-d402aaf242b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:45.598010 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d885ad5-234b-4043-a9eb-d402aaf242b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:45.599372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d885ad5-234b-4043-a9eb-d402aaf242b1 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:45.608837 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 461/935] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Sep 25 00:42:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:45.614669 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0dd5d-cde6-403f-ba3d-152a4e9840d3 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:45.671291 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:45.728942 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0dd5d-cde6-403f-ba3d-152a4e9840d3 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:45.772100 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc559c-4c92-4446-be85-5681dc85d031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:45.772842 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc559c-4c92-4446-be85-5681dc85d031 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:45.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc559c-4c92-4446-be85-5681dc85d031 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:45.773398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc559c-4c92-4446-be85-5681dc85d031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:45.784782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc559c-4c92-4446-be85-5681dc85d031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:45.786234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc559c-4c92-4446-be85-5681dc85d031 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-03dc559c-4c92-4446-be85-5681dc85d031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:45.801906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:45.802884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:45.804141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:45.804141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:45.804141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:45.804141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 475/936] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:45.809585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d885ad5-234b-4043-a9eb-d402aaf242b1 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:45.884560 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:45.933613 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d885ad5-234b-4043-a9eb-d402aaf242b1 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:45.957156 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c124e-1f65-4c1f-8dbc-8624406b410e None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:45.957486 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c124e-1f65-4c1f-8dbc-8624406b410e None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:45.957702 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c124e-1f65-4c1f-8dbc-8624406b410e None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:45.959297 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 476/937] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:45.965247 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6416cf-d564-4825-8377-7de12cebeaf8 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:45.965538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6416cf-d564-4825-8377-7de12cebeaf8 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:45.965816 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6416cf-d564-4825-8377-7de12cebeaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:45.969080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6189b-a020-4365-a10e-669a267aa626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:45.969786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6189b-a020-4365-a10e-669a267aa626 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:45.970065 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6189b-a020-4365-a10e-669a267aa626 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:45.970340 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6189b-a020-4365-a10e-669a267aa626 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:45.971069 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6189b-a020-4365-a10e-669a267aa626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:45.971377 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6189b-a020-4365-a10e-669a267aa626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:45.972760 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6189b-a020-4365-a10e-669a267aa626 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:45.985217 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-2e6416cf-d564-4825-8377-7de12cebeaf8 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:45.985701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 462/938] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:45.986597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-2e6416cf-d564-4825-8377-7de12cebeaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:45.992219 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6189b-a020-4365-a10e-669a267aa626 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:46.071791 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 477/939] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:46.109194 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6189b-a020-4365-a10e-669a267aa626 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:46.125080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:46.145904 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8560a7-060a-407f-83c0-d970c9474d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:46.146543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8560a7-060a-407f-83c0-d970c9474d8f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:46.146826 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8560a7-060a-407f-83c0-d970c9474d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:46.147102 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8560a7-060a-407f-83c0-d970c9474d8f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:46.155008 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8560a7-060a-407f-83c0-d970c9474d8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:46.156457 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8560a7-060a-407f-83c0-d970c9474d8f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-cb8560a7-060a-407f-83c0-d970c9474d8f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:46.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:46.169051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:46.170287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:46.170287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:46.170287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:46.170287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:46.170287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:46.170287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:46.170287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:46.170287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:46.170287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:42:46.170287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:46.170287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 463/940] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Sep 25 00:42:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:46.175019 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6416cf-d564-4825-8377-7de12cebeaf8 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:46.220120 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:46.223972 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064faab-3b8b-43c4-9972-8b5a0ebf039e None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:46.224260 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064faab-3b8b-43c4-9972-8b5a0ebf039e None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:46.224677 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064faab-3b8b-43c4-9972-8b5a0ebf039e None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:46.226021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 464/941] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:46.231781 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e73d79-8683-44c1-bd72-18fade36ad92 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:46.232375 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e73d79-8683-44c1-bd72-18fade36ad92 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:46.232863 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e73d79-8683-44c1-bd72-18fade36ad92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:46.251947 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-65e73d79-8683-44c1-bd72-18fade36ad92 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:46.253579 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-65e73d79-8683-44c1-bd72-18fade36ad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:46.294239 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6416cf-d564-4825-8377-7de12cebeaf8 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:46.336595 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 465/942] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:46.336787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efea67-948c-4be5-8222-744a2cc46e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:46.336787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efea67-948c-4be5-8222-744a2cc46e15 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:46.336787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efea67-948c-4be5-8222-744a2cc46e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:46.336787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efea67-948c-4be5-8222-744a2cc46e15 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:46.337651 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efea67-948c-4be5-8222-744a2cc46e15 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:46.337651 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efea67-948c-4be5-8222-744a2cc46e15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:46.337651 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efea67-948c-4be5-8222-744a2cc46e15 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:46.351595 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e73d79-8683-44c1-bd72-18fade36ad92 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:46.354154 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 478/943] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Sep 25 00:42:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:46.359754 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efea67-948c-4be5-8222-744a2cc46e15 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:46.460869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e73d79-8683-44c1-bd72-18fade36ad92 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:46.464575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:46.487421 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:46.500852 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efea67-948c-4be5-8222-744a2cc46e15 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:46.501960 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496217d6-7cce-4b45-9888-f0c19bfc1371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:46.502691 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496217d6-7cce-4b45-9888-f0c19bfc1371 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:46.503232 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496217d6-7cce-4b45-9888-f0c19bfc1371 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:46.503602 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496217d6-7cce-4b45-9888-f0c19bfc1371 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:46.505023 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496217d6-7cce-4b45-9888-f0c19bfc1371 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:46.506181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496217d6-7cce-4b45-9888-f0c19bfc1371 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:46.509542 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: WARNING keystone.server.flask.common [None req-496217d6-7cce-4b45-9888-f0c19bfc1371 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 25 00:42:46.529401 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.sql.core [None req-496217d6-7cce-4b45-9888-f0c19bfc1371 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 25 00:42:46.529401 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 25 00:42:46.529401 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [parameters: {'id': '25e2cacaabfa4e6e8bd8074d91fc847f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 25 00:42:46.529401 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81371) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 25 00:42:46.538550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-496217d6-7cce-4b45-9888-f0c19bfc1371 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 25e2cacaabfa4e6e8bd8074d91fc847f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 25e2cacaabfa4e6e8bd8074d91fc847f. Sep 25 00:42:46.538550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:46.538550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 00:42:46.538550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 00:42:46.538550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 00:42:46.538550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 00:42:46.538550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 00:42:46.538550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 00:42:46.538550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 00:42:46.538550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application conn.query(q) Sep 25 00:42:46.538550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 00:42:46.538550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 00:42:46.538550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application result.read() Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 25 00:42:46.539463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application next(self.gen) Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application yield resource Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application next(self.gen) Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.session.rollback() Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.force_reraise() Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise self.value Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application session.commit() Sep 25 00:42:46.540438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._prepare_impl() Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.session.flush() Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._flush(objects) Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application compat.raise_( Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application flush_context.execute() Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 00:42:46.541370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rec.execute(self) Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 25 00:42:46.542235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application conn.query(q) Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application result.read() Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 00:42:46.543020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [parameters: {'id': '25e2cacaabfa4e6e8bd8074d91fc847f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:46.543900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:46.545956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:46.548032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:46.548032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 25 00:42:46.548032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 25 00:42:46.548032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:46.548032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:46.548032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 25 00:42:46.548032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 25 00:42:46.548032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 25e2cacaabfa4e6e8bd8074d91fc847f. Sep 25 00:42:46.548032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:46.548032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 466/944] 10.222.0.27 () {60 vars in 1140 bytes} [Sun Sep 25 00:42:46 2022] POST /identity/v3/projects => generated 262 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:46.548032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496217d6-7cce-4b45-9888-f0c19bfc1371 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:46.553716 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0609c5-2c93-4845-ac64-cfdd56848c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:46.554603 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0609c5-2c93-4845-ac64-cfdd56848c3b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:46.555093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0609c5-2c93-4845-ac64-cfdd56848c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:46.555555 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0609c5-2c93-4845-ac64-cfdd56848c3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:46.567794 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0609c5-2c93-4845-ac64-cfdd56848c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:46.569956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0609c5-2c93-4845-ac64-cfdd56848c3b None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-ac0609c5-2c93-4845-ac64-cfdd56848c3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:46.586560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:46.587561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:46.588429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:46.588429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:46.588429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:46.594803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 479/945] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:46.595867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0609c5-2c93-4845-ac64-cfdd56848c3b None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:46.654663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496217d6-7cce-4b45-9888-f0c19bfc1371 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:46.690009 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be830529-63a1-4b91-afc2-fbd3c1e89641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:46.690747 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830529-63a1-4b91-afc2-fbd3c1e89641 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:46.691022 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830529-63a1-4b91-afc2-fbd3c1e89641 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:46.691403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830529-63a1-4b91-afc2-fbd3c1e89641 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:46.699628 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be830529-63a1-4b91-afc2-fbd3c1e89641 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:46.700489 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0609c5-2c93-4845-ac64-cfdd56848c3b None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:46.701291 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be830529-63a1-4b91-afc2-fbd3c1e89641 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-be830529-63a1-4b91-afc2-fbd3c1e89641 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:46.713482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:46.714355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:46.715248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:46.715248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:46.715248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:46.715248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:46.715248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:46.715248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:46.715248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:46.715248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:46.715248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 467/946] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:46.715728 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be830529-63a1-4b91-afc2-fbd3c1e89641 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:46.738745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018849b-ac83-41d4-8f60-071c4659b472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:46.739278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018849b-ac83-41d4-8f60-071c4659b472 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:46.739557 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018849b-ac83-41d4-8f60-071c4659b472 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:46.739826 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018849b-ac83-41d4-8f60-071c4659b472 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:46.740168 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:46.740466 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018849b-ac83-41d4-8f60-071c4659b472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:46.740802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018849b-ac83-41d4-8f60-071c4659b472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:46.742303 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018849b-ac83-41d4-8f60-071c4659b472 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:46.758777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 480/947] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:46.758777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018849b-ac83-41d4-8f60-071c4659b472 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:46.760865 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:46.835129 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be830529-63a1-4b91-afc2-fbd3c1e89641 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:46.864037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018849b-ac83-41d4-8f60-071c4659b472 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:46.870346 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450946e-d097-44b4-aa37-027a109fe007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:46.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450946e-d097-44b4-aa37-027a109fe007 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:46.871511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450946e-d097-44b4-aa37-027a109fe007 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:46.871780 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450946e-d097-44b4-aa37-027a109fe007 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:46.872360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450946e-d097-44b4-aa37-027a109fe007 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:46.873807 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450946e-d097-44b4-aa37-027a109fe007 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-8450946e-d097-44b4-aa37-027a109fe007 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:46.883467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:46.885221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:46.886033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:46.886033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:46.886033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:46.886033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:46.886033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:46.886033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:46.886033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:46.886033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:46.886033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:46.886033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:46.886033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:46.886033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:46.886033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:46.886033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:46.888691 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 468/948] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Sep 25 00:42:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:46.889800 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450946e-d097-44b4-aa37-027a109fe007 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:46.905083 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1da13-d7b4-4ec4-b936-0a3c80ff4bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:46.905698 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1da13-d7b4-4ec4-b936-0a3c80ff4bec None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:46.905977 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1da13-d7b4-4ec4-b936-0a3c80ff4bec None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:46.906572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1da13-d7b4-4ec4-b936-0a3c80ff4bec None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:46.906919 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1da13-d7b4-4ec4-b936-0a3c80ff4bec None admin] RBAC: Adding query filter params (name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:46.907223 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1da13-d7b4-4ec4-b936-0a3c80ff4bec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:46.908674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1da13-d7b4-4ec4-b936-0a3c80ff4bec None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:46.925904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 481/949] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Sep 25 00:42:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:46.926546 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1da13-d7b4-4ec4-b936-0a3c80ff4bec None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:47.007551 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:47.013632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:47.032965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450946e-d097-44b4-aa37-027a109fe007 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:47.057012 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1da13-d7b4-4ec4-b936-0a3c80ff4bec None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:47.073495 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76630e23-7edd-4f42-ac79-92f1867e1910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:47.074896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76630e23-7edd-4f42-ac79-92f1867e1910 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:47.075596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76630e23-7edd-4f42-ac79-92f1867e1910 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:47.076013 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76630e23-7edd-4f42-ac79-92f1867e1910 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:47.085017 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76630e23-7edd-4f42-ac79-92f1867e1910 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:47.088184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76630e23-7edd-4f42-ac79-92f1867e1910 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:47.098269 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cabd1-9e14-4417-87ba-504b70cd371d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:47.099008 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cabd1-9e14-4417-87ba-504b70cd371d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:47.099345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cabd1-9e14-4417-87ba-504b70cd371d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:47.099689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cabd1-9e14-4417-87ba-504b70cd371d None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:47.100474 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cabd1-9e14-4417-87ba-504b70cd371d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:47.100888 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cabd1-9e14-4417-87ba-504b70cd371d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:47.102343 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cabd1-9e14-4417-87ba-504b70cd371d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-76630e23-7edd-4f42-ac79-92f1867e1910 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:47.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:47.105126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:47.106222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:47.106222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:47.106222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:47.106222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:47.106222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:47.106222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:47.106222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:47.106222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:47.108352 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 469/950] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:47.110582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 482/951] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Sep 25 00:42:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:47.113684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76630e23-7edd-4f42-ac79-92f1867e1910 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:47.117856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cabd1-9e14-4417-87ba-504b70cd371d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:47.244757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76630e23-7edd-4f42-ac79-92f1867e1910 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:47.246371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cabd1-9e14-4417-87ba-504b70cd371d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:47.278823 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:47.284647 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dac9a-0fe3-4af4-b66d-dcea23830d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:47.285266 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dac9a-0fe3-4af4-b66d-dcea23830d0d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:47.285548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dac9a-0fe3-4af4-b66d-dcea23830d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:47.285820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dac9a-0fe3-4af4-b66d-dcea23830d0d None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:47.286574 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dac9a-0fe3-4af4-b66d-dcea23830d0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:47.286888 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dac9a-0fe3-4af4-b66d-dcea23830d0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:47.288323 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dac9a-0fe3-4af4-b66d-dcea23830d0d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:47.289482 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8b2f0-57b6-4584-b595-e25deaf873ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:47.290283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8b2f0-57b6-4584-b595-e25deaf873ac None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:47.290699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8b2f0-57b6-4584-b595-e25deaf873ac None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:47.291128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8b2f0-57b6-4584-b595-e25deaf873ac None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:47.291974 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8b2f0-57b6-4584-b595-e25deaf873ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:47.292415 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8b2f0-57b6-4584-b595-e25deaf873ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:47.293927 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8b2f0-57b6-4584-b595-e25deaf873ac None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:47.299745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 483/952] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Sep 25 00:42:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:47.304403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 470/953] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:47.307125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8b2f0-57b6-4584-b595-e25deaf873ac None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:47.310264 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dac9a-0fe3-4af4-b66d-dcea23830d0d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:47.317679 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:47.432492 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8b2f0-57b6-4584-b595-e25deaf873ac None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:47.442176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dac9a-0fe3-4af4-b66d-dcea23830d0d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:47.470198 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf033809-e289-4165-b8cb-fb78c3d601c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:47.470810 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf033809-e289-4165-b8cb-fb78c3d601c8 None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:47.471087 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf033809-e289-4165-b8cb-fb78c3d601c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:47.471359 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf033809-e289-4165-b8cb-fb78c3d601c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:47.472038 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf033809-e289-4165-b8cb-fb78c3d601c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:47.473449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf033809-e289-4165-b8cb-fb78c3d601c8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:47.484640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6729e3b-b634-49bf-ad70-6958defe978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:47.485663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6729e3b-b634-49bf-ad70-6958defe978b None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:47.486292 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6729e3b-b634-49bf-ad70-6958defe978b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:47.486798 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6729e3b-b634-49bf-ad70-6958defe978b None admin] PATH_INFO: `/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/6c53cca11c1c45a89651026d2ac75cc2/roles/01d4be0e55534d58aea1a76f9441d7f4` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:47.489597 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6729e3b-b634-49bf-ad70-6958defe978b None admin] RBAC: Authorizing `identity:create_grant(project_id=9d5f67cc330446d1b77c741139f68e15, user_id=6c53cca11c1c45a89651026d2ac75cc2, role_id=01d4be0e55534d58aea1a76f9441d7f4)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:47.491277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6729e3b-b634-49bf-ad70-6958defe978b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:47.496173 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 484/954] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Sep 25 00:42:47 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:42:47.517797 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 471/955] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:42:47 2022] PUT /identity/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/6c53cca11c1c45a89651026d2ac75cc2/roles/01d4be0e55534d58aea1a76f9441d7f4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:42:47.715938 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30be9-6f82-49e7-9908-12d3aaa32660 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:47.716256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30be9-6f82-49e7-9908-12d3aaa32660 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:47.716490 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30be9-6f82-49e7-9908-12d3aaa32660 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:47.718172 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 485/956] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:47.724300 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c60f82-c40a-4883-9305-96c81ebd138b None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:47.724821 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c60f82-c40a-4883-9305-96c81ebd138b None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:47.725237 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c60f82-c40a-4883-9305-96c81ebd138b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:47.745593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-42c60f82-c40a-4883-9305-96c81ebd138b None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:47.747129 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-42c60f82-c40a-4883-9305-96c81ebd138b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:47.826393 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:47.848692 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 472/957] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:48.110789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd30be9-6f82-49e7-9908-12d3aaa32660 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:48.173907 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:48.238904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd30be9-6f82-49e7-9908-12d3aaa32660 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:48.273422 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09905565-70a3-47ae-95b5-6c070f650eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:48.274867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905565-70a3-47ae-95b5-6c070f650eca None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:48.275293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905565-70a3-47ae-95b5-6c070f650eca None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:48.275714 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905565-70a3-47ae-95b5-6c070f650eca None admin] PATH_INFO: `/v3/services/compute` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:48.276449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09905565-70a3-47ae-95b5-6c070f650eca None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:48.277980 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09905565-70a3-47ae-95b5-6c070f650eca None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-09905565-70a3-47ae-95b5-6c070f650eca None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:48.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:48.288701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:48.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:48.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:48.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:48.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:48.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:48.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:48.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:48.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:48.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:48.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:48.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:48.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:48.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:42:48.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:48.292764 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 486/958] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:48.301878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c60f82-c40a-4883-9305-96c81ebd138b None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:48.407596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c60f82-c40a-4883-9305-96c81ebd138b None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:48.445244 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ed517-7188-4bfb-95cb-372678822b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:48.445864 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ed517-7188-4bfb-95cb-372678822b9a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:48.446750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ed517-7188-4bfb-95cb-372678822b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:48.447155 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ed517-7188-4bfb-95cb-372678822b9a None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:48.448039 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ed517-7188-4bfb-95cb-372678822b9a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:48.448345 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ed517-7188-4bfb-95cb-372678822b9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:48.449749 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ed517-7188-4bfb-95cb-372678822b9a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:48.455270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 473/959] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Sep 25 00:42:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:48.460931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09905565-70a3-47ae-95b5-6c070f650eca None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:48.567946 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09905565-70a3-47ae-95b5-6c070f650eca None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:48.583775 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:48.605819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26262046-87b6-4074-a03e-c84534828229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:48.606426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26262046-87b6-4074-a03e-c84534828229 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:48.606701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26262046-87b6-4074-a03e-c84534828229 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:48.606975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26262046-87b6-4074-a03e-c84534828229 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:48.607602 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26262046-87b6-4074-a03e-c84534828229 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:48.607904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26262046-87b6-4074-a03e-c84534828229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:48.609415 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26262046-87b6-4074-a03e-c84534828229 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:48.614227 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 487/960] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Sep 25 00:42:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:49.318110 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b66d-7797-40ab-a40e-aaf55176d653 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:49.318626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b66d-7797-40ab-a40e-aaf55176d653 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:49.318703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b66d-7797-40ab-a40e-aaf55176d653 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:49.320527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 474/961] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:49.326215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21acf82-90ba-483f-891e-26f1363130c7 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:49.326501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21acf82-90ba-483f-891e-26f1363130c7 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:49.326779 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21acf82-90ba-483f-891e-26f1363130c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:49.345299 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-d21acf82-90ba-483f-891e-26f1363130c7 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:49.346508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-d21acf82-90ba-483f-891e-26f1363130c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:49.420700 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 488/962] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:49.704051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b66d-7797-40ab-a40e-aaf55176d653 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:49.718294 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305f8e3-f206-40bb-b1a8-d22cf8f44288 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:49.718774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305f8e3-f206-40bb-b1a8-d22cf8f44288 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:49.718871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305f8e3-f206-40bb-b1a8-d22cf8f44288 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:49.720394 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 489/963] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:49.725471 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087b5fa-deda-4120-a725-3224a57f6fd3 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:49.725758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087b5fa-deda-4120-a725-3224a57f6fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:49.726040 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087b5fa-deda-4120-a725-3224a57f6fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:49.747781 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-5087b5fa-deda-4120-a725-3224a57f6fd3 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:49.749030 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-5087b5fa-deda-4120-a725-3224a57f6fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:49.766842 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:49.840212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b66d-7797-40ab-a40e-aaf55176d653 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:49.854146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 490/964] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:49.880746 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de613b-a684-4cfc-a1bc-fa35210181c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:49.881926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de613b-a684-4cfc-a1bc-fa35210181c6 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:49.882436 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de613b-a684-4cfc-a1bc-fa35210181c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:49.882915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de613b-a684-4cfc-a1bc-fa35210181c6 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:49.884367 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de613b-a684-4cfc-a1bc-fa35210181c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:49.886096 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de613b-a684-4cfc-a1bc-fa35210181c6 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:49.902149 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.sql.core [None req-c5de613b-a684-4cfc-a1bc-fa35210181c6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 25 00:42:49.902149 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 25 00:42:49.902149 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [parameters: {'user_id': '21374a7eec42447b958dd10e5e2822af', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 25 00:42:49.902149 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81371) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 25 00:42:49.905164 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97084327-7dfb-4a27-9640-7ea0f832b6ff None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:49.905452 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97084327-7dfb-4a27-9640-7ea0f832b6ff None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:49.905731 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97084327-7dfb-4a27-9640-7ea0f832b6ff None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:49.907315 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 491/965] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-c5de613b-a684-4cfc-a1bc-fa35210181c6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application conn.query(q) Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application result.read() Sep 25 00:42:49.911059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 00:42:49.911901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application next(self.gen) Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application yield resource Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application next(self.gen) Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.session.rollback() Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.force_reraise() Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise self.value Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application session.commit() Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 25 00:42:49.912932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._prepare_impl() Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.session.flush() Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._flush(objects) Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application compat.raise_( Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application flush_context.execute() Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rec.execute(self) Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 25 00:42:49.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 00:42:49.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application conn.query(q) Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application result.read() Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 00:42:49.917183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [parameters: {'user_id': '21374a7eec42447b958dd10e5e2822af', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:49.924145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 25 00:42:49.926178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 25 00:42:49.928439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 25 00:42:49.928439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 25 00:42:49.928439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 25 00:42:49.928439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 25 00:42:49.928439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 25 00:42:49.928439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:49.929274 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6305cf-2692-4306-aa10-f022f6fe3fe0 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:49.929274 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6305cf-2692-4306-aa10-f022f6fe3fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:49.929274 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6305cf-2692-4306-aa10-f022f6fe3fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:49.929751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 475/966] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Sep 25 00:42:49 2022] POST /identity/v3/users => generated 160 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:49.929751 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de613b-a684-4cfc-a1bc-fa35210181c6 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:49.940581 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-4e6305cf-2692-4306-aa10-f022f6fe3fe0 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:49.940581 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-4e6305cf-2692-4306-aa10-f022f6fe3fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:49.981706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:50.031668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 492/967] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:50.055901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de613b-a684-4cfc-a1bc-fa35210181c6 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:50.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:50.092512 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa3951-f3fc-4658-ad36-8b6211a240fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:50.093398 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3951-f3fc-4658-ad36-8b6211a240fb None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:50.093818 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3951-f3fc-4658-ad36-8b6211a240fb None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:50.094273 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3951-f3fc-4658-ad36-8b6211a240fb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:50.102534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa3951-f3fc-4658-ad36-8b6211a240fb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:50.104346 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa3951-f3fc-4658-ad36-8b6211a240fb None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-b7aa3951-f3fc-4658-ad36-8b6211a240fb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:50.116021 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:50.117141 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:50.118384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:50.118384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:50.118384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:50.118384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:50.118384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:50.118384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:50.118384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:50.118384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:50.118384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:42:50.118384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:50.120567 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 476/968] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:42:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:50.125909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6305cf-2692-4306-aa10-f022f6fe3fe0 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:50.129630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa3951-f3fc-4658-ad36-8b6211a240fb None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:50.234113 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa3951-f3fc-4658-ad36-8b6211a240fb None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:50.252061 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6305cf-2692-4306-aa10-f022f6fe3fe0 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:50.269005 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224e195-b5af-4e40-b3f1-780162b81ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:50.269612 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224e195-b5af-4e40-b3f1-780162b81ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:50.269892 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224e195-b5af-4e40-b3f1-780162b81ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:50.270169 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224e195-b5af-4e40-b3f1-780162b81ee6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:50.282093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224e195-b5af-4e40-b3f1-780162b81ee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-e224e195-b5af-4e40-b3f1-780162b81ee6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:42:50.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:50.288828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:50.289929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:50.289929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:50.289929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:50.289929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:50.289929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:42:50.289929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:42:50.289929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:42:50.289929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:42:50.289929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:42:50.289929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:42:50.289929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:42:50.289929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:50.292736 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260a38d-0a44-4e86-8540-6fff961d1271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:50.293605 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260a38d-0a44-4e86-8540-6fff961d1271 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:50.293966 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 477/969] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Sep 25 00:42:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:50.294230 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260a38d-0a44-4e86-8540-6fff961d1271 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:50.294651 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260a38d-0a44-4e86-8540-6fff961d1271 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:50.294862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224e195-b5af-4e40-b3f1-780162b81ee6 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:50.295748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260a38d-0a44-4e86-8540-6fff961d1271 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:50.296203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260a38d-0a44-4e86-8540-6fff961d1271 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:50.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260a38d-0a44-4e86-8540-6fff961d1271 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:50.332802 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:50.336382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 493/970] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Sep 25 00:42:50 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:50.337351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260a38d-0a44-4e86-8540-6fff961d1271 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:50.371800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:50.422060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224e195-b5af-4e40-b3f1-780162b81ee6 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:50.474904 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855f890-9fdd-4266-80a7-f085ea34012d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:50.475147 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260a38d-0a44-4e86-8540-6fff961d1271 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:50.476011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855f890-9fdd-4266-80a7-f085ea34012d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:50.476489 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855f890-9fdd-4266-80a7-f085ea34012d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:50.477343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855f890-9fdd-4266-80a7-f085ea34012d None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:50.479334 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855f890-9fdd-4266-80a7-f085ea34012d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:50.479881 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855f890-9fdd-4266-80a7-f085ea34012d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:50.481539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855f890-9fdd-4266-80a7-f085ea34012d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:50.498892 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 478/971] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Sep 25 00:42:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:50.508461 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855f890-9fdd-4266-80a7-f085ea34012d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:50.517700 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25861803-c6c7-4153-9676-143f26022757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:50.518453 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25861803-c6c7-4153-9676-143f26022757 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:50.518803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25861803-c6c7-4153-9676-143f26022757 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:50.519149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25861803-c6c7-4153-9676-143f26022757 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:50.519812 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25861803-c6c7-4153-9676-143f26022757 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:50.521845 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25861803-c6c7-4153-9676-143f26022757 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-25861803-c6c7-4153-9676-143f26022757 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:50.534583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:50.535609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:50.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 494/972] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Sep 25 00:42:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:50.544258 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25861803-c6c7-4153-9676-143f26022757 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:50.632950 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:50.640702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855f890-9fdd-4266-80a7-f085ea34012d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:50.665476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:50.676083 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25861803-c6c7-4153-9676-143f26022757 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:50.678439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453445f2-c695-40a0-815a-af081707389c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:50.679117 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453445f2-c695-40a0-815a-af081707389c None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:50.679393 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453445f2-c695-40a0-815a-af081707389c None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:50.679672 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453445f2-c695-40a0-815a-af081707389c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:50.691069 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453445f2-c695-40a0-815a-af081707389c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:50.692522 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453445f2-c695-40a0-815a-af081707389c None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-453445f2-c695-40a0-815a-af081707389c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:50.708078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:50.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:50.710153 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:50.710153 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:50.710153 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:50.710153 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 479/973] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:50.715132 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453445f2-c695-40a0-815a-af081707389c None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:50.716926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29009230-1108-4f9d-83de-2a5aa86c2553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:50.717559 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009230-1108-4f9d-83de-2a5aa86c2553 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:50.718080 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009230-1108-4f9d-83de-2a5aa86c2553 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:50.718427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009230-1108-4f9d-83de-2a5aa86c2553 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:50.720055 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29009230-1108-4f9d-83de-2a5aa86c2553 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:50.720363 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29009230-1108-4f9d-83de-2a5aa86c2553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:50.721835 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29009230-1108-4f9d-83de-2a5aa86c2553 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:50.728134 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 495/974] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Sep 25 00:42:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:50.734078 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29009230-1108-4f9d-83de-2a5aa86c2553 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:50.830221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453445f2-c695-40a0-815a-af081707389c None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:50.841289 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29009230-1108-4f9d-83de-2a5aa86c2553 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:50.863186 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8bcb2-dc13-4c22-8517-22d62fac334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:50.863787 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8bcb2-dc13-4c22-8517-22d62fac334e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:50.864062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8bcb2-dc13-4c22-8517-22d62fac334e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:50.864330 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8bcb2-dc13-4c22-8517-22d62fac334e None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:50.864977 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8bcb2-dc13-4c22-8517-22d62fac334e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:50.865260 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8bcb2-dc13-4c22-8517-22d62fac334e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:50.866628 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8bcb2-dc13-4c22-8517-22d62fac334e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:50.875392 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ce376-ca68-4976-8756-5f5988382c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:50.875989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ce376-ca68-4976-8756-5f5988382c53 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:50.876267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ce376-ca68-4976-8756-5f5988382c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:50.876536 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ce376-ca68-4976-8756-5f5988382c53 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:50.877182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ce376-ca68-4976-8756-5f5988382c53 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:50.877481 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ce376-ca68-4976-8756-5f5988382c53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:50.878593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 480/975] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:50.878830 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ce376-ca68-4976-8756-5f5988382c53 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:50.879807 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dacd3-3bec-48eb-8052-93098c74a3d9 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:50.880099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dacd3-3bec-48eb-8052-93098c74a3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:50.880373 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dacd3-3bec-48eb-8052-93098c74a3d9 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:50.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 481/976] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:50.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dacd3-3bec-48eb-8052-93098c74a3d9 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:50.884854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 496/977] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Sep 25 00:42:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:50.886941 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4606e-f7aa-44e1-93af-dac6143e7dd0 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:50.887217 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4606e-f7aa-44e1-93af-dac6143e7dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:50.887487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4606e-f7aa-44e1-93af-dac6143e7dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:50.900493 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:50.905003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-7ef4606e-f7aa-44e1-93af-dac6143e7dd0 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:50.906189 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-7ef4606e-f7aa-44e1-93af-dac6143e7dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:50.917254 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:50.972438 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 497/978] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:50.973281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4606e-f7aa-44e1-93af-dac6143e7dd0 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:50.995207 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dacd3-3bec-48eb-8052-93098c74a3d9 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:51.029638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c2b36-e928-4d24-8a3f-e1f7ef9aa062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:51.030266 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2b36-e928-4d24-8a3f-e1f7ef9aa062 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:51.030542 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2b36-e928-4d24-8a3f-e1f7ef9aa062 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:51.030812 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2b36-e928-4d24-8a3f-e1f7ef9aa062 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:51.037670 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c2b36-e928-4d24-8a3f-e1f7ef9aa062 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:51.039100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c2b36-e928-4d24-8a3f-e1f7ef9aa062 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-ce0c2b36-e928-4d24-8a3f-e1f7ef9aa062 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:42:51.051057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:51.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:51.053295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:51.053295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:51.053295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:42:51.053295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:42:51.053295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:42:51.053295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:42:51.053295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:42:51.053295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:42:51.053295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:42:51.053295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:51.053295 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 482/979] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Sep 25 00:42:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:51.057884 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c2b36-e928-4d24-8a3f-e1f7ef9aa062 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:51.077868 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4606e-f7aa-44e1-93af-dac6143e7dd0 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:51.115721 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524e1af-b29e-4bc1-b04f-69c5456b2ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:51.116322 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524e1af-b29e-4bc1-b04f-69c5456b2ffe None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:51.116617 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524e1af-b29e-4bc1-b04f-69c5456b2ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:51.116887 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524e1af-b29e-4bc1-b04f-69c5456b2ffe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:51.117587 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524e1af-b29e-4bc1-b04f-69c5456b2ffe None admin] RBAC: Adding query filter params (interface=admin, service_id=82afdb5620a4425e8637de3c43aab126, region_id=RegionOne) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:51.117977 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524e1af-b29e-4bc1-b04f-69c5456b2ffe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:51.119364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524e1af-b29e-4bc1-b04f-69c5456b2ffe None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:51.126916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 498/980] 10.222.0.27 () {56 vars in 1249 bytes} [Sun Sep 25 00:42:50 2022] GET /identity/v3/endpoints?service_id=82afdb5620a4425e8637de3c43aab126&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:51.130161 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:51.132791 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524e1af-b29e-4bc1-b04f-69c5456b2ffe None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:51.145107 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:51.163034 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c2b36-e928-4d24-8a3f-e1f7ef9aa062 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:51.200668 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fed44-9635-4c2c-a530-dd99cbf8ea66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:51.201785 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fed44-9635-4c2c-a530-dd99cbf8ea66 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:51.202078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fed44-9635-4c2c-a530-dd99cbf8ea66 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:51.202358 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fed44-9635-4c2c-a530-dd99cbf8ea66 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:51.203370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fed44-9635-4c2c-a530-dd99cbf8ea66 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:51.203682 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fed44-9635-4c2c-a530-dd99cbf8ea66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:51.205153 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fed44-9635-4c2c-a530-dd99cbf8ea66 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:51.223931 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 483/981] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Sep 25 00:42:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:51.229924 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fed44-9635-4c2c-a530-dd99cbf8ea66 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:51.240138 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524e1af-b29e-4bc1-b04f-69c5456b2ffe None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:51.272370 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486f0a9-069c-43dc-85d3-35aace8c87af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:51.273004 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486f0a9-069c-43dc-85d3-35aace8c87af None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:51.273287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486f0a9-069c-43dc-85d3-35aace8c87af None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:51.273565 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486f0a9-069c-43dc-85d3-35aace8c87af None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:51.274708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486f0a9-069c-43dc-85d3-35aace8c87af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:51.276074 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486f0a9-069c-43dc-85d3-35aace8c87af None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:51.281856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 499/982] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Sep 25 00:42:51 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 00:42:51.282603 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486f0a9-069c-43dc-85d3-35aace8c87af None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:51.332745 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fed44-9635-4c2c-a530-dd99cbf8ea66 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:51.366750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:51.368830 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:51.380134 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92d0db-ff5c-4b49-9540-0b3096e90f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:51.380787 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92d0db-ff5c-4b49-9540-0b3096e90f78 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:51.381063 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92d0db-ff5c-4b49-9540-0b3096e90f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:51.381330 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92d0db-ff5c-4b49-9540-0b3096e90f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:51.400477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486f0a9-069c-43dc-85d3-35aace8c87af None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:51.436981 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b84a0-bd57-4bee-861e-87c33991455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:51.437613 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b84a0-bd57-4bee-861e-87c33991455d None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:51.437894 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b84a0-bd57-4bee-861e-87c33991455d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:51.438169 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b84a0-bd57-4bee-861e-87c33991455d None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:51.438850 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b84a0-bd57-4bee-861e-87c33991455d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:51.440371 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b84a0-bd57-4bee-861e-87c33991455d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:51.461081 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 500/983] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Sep 25 00:42:51 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:42:51.464229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92d0db-ff5c-4b49-9540-0b3096e90f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:51.465745 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92d0db-ff5c-4b49-9540-0b3096e90f78 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:51.585951 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 484/984] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:42:51 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 00:42:51.592068 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b84a0-bd57-4bee-861e-87c33991455d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:51.704849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b84a0-bd57-4bee-861e-87c33991455d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:51.732806 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:51.738541 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c02be-6ea0-4c54-8b02-66e60feaae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:51.739178 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c02be-6ea0-4c54-8b02-66e60feaae3f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:51.739513 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c02be-6ea0-4c54-8b02-66e60feaae3f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:51.739795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c02be-6ea0-4c54-8b02-66e60feaae3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:51.751850 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c02be-6ea0-4c54-8b02-66e60feaae3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:51.753349 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c02be-6ea0-4c54-8b02-66e60feaae3f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-900c02be-6ea0-4c54-8b02-66e60feaae3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:42:51.768001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:51.769243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:42:51.770588 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:42:51.770588 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:42:51.770588 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:51.770588 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 501/985] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:51.775635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92d0db-ff5c-4b49-9540-0b3096e90f78 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:51.804058 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:51.883984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92d0db-ff5c-4b49-9540-0b3096e90f78 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:51.918685 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bba4f-3c73-43fc-a620-3cf7e0302e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:51.919290 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bba4f-3c73-43fc-a620-3cf7e0302e1f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:51.919564 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bba4f-3c73-43fc-a620-3cf7e0302e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:51.919833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bba4f-3c73-43fc-a620-3cf7e0302e1f None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:51.920467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bba4f-3c73-43fc-a620-3cf7e0302e1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:51.920810 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bba4f-3c73-43fc-a620-3cf7e0302e1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:51.922164 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bba4f-3c73-43fc-a620-3cf7e0302e1f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:51.933539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 485/986] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:51.938917 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c02be-6ea0-4c54-8b02-66e60feaae3f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:52.049194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c02be-6ea0-4c54-8b02-66e60feaae3f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:52.083402 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0cd11-c1be-48c2-b814-aabef9190a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:52.084037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cd11-c1be-48c2-b814-aabef9190a8c None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:52.084317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cd11-c1be-48c2-b814-aabef9190a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:52.084612 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cd11-c1be-48c2-b814-aabef9190a8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:52.091690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0cd11-c1be-48c2-b814-aabef9190a8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:52.093166 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0cd11-c1be-48c2-b814-aabef9190a8c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-28c0cd11-c1be-48c2-b814-aabef9190a8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:42:52.104898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:52.105859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:52.106753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:42:52.106753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:42:52.106753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:42:52.106753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:42:52.106753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:42:52.106753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:42:52.106753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:42:52.106753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:52.106753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 502/987] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:52.111919 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bba4f-3c73-43fc-a620-3cf7e0302e1f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:52.204326 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:52.218645 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bba4f-3c73-43fc-a620-3cf7e0302e1f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:52.254076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6f8f1-49ed-4584-91b0-2725f1ddc269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:52.254783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6f8f1-49ed-4584-91b0-2725f1ddc269 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:52.255138 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6f8f1-49ed-4584-91b0-2725f1ddc269 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:52.255486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6f8f1-49ed-4584-91b0-2725f1ddc269 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:52.256256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6f8f1-49ed-4584-91b0-2725f1ddc269 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:52.256663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6f8f1-49ed-4584-91b0-2725f1ddc269 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:52.258740 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6f8f1-49ed-4584-91b0-2725f1ddc269 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:52.270921 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 486/988] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:52.277270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0cd11-c1be-48c2-b814-aabef9190a8c None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:52.321329 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:52.379149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0cd11-c1be-48c2-b814-aabef9190a8c None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:52.414486 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109a5f4-ef6b-471a-9f91-eec4980cb37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:52.415090 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109a5f4-ef6b-471a-9f91-eec4980cb37d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:52.415364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109a5f4-ef6b-471a-9f91-eec4980cb37d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:52.415633 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109a5f4-ef6b-471a-9f91-eec4980cb37d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:52.416344 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109a5f4-ef6b-471a-9f91-eec4980cb37d None admin] RBAC: Adding query filter params (role.id=01d4be0e55534d58aea1a76f9441d7f4, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=6c53cca11c1c45a89651026d2ac75cc2) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:52.416676 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109a5f4-ef6b-471a-9f91-eec4980cb37d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:52.418093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109a5f4-ef6b-471a-9f91-eec4980cb37d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:52.432576 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 503/989] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:42:52 2022] GET /identity/v3/role_assignments?user.id=6c53cca11c1c45a89651026d2ac75cc2&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=01d4be0e55534d58aea1a76f9441d7f4 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:53.463521 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cdd14-aef7-41f4-b56f-47296edc0951 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:53.464040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cdd14-aef7-41f4-b56f-47296edc0951 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:53.464040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cdd14-aef7-41f4-b56f-47296edc0951 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:53.465564 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 487/990] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:53.470648 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f019d0f-b725-4695-89c1-94a2bc6b3fe0 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:53.471031 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f019d0f-b725-4695-89c1-94a2bc6b3fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:53.471207 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f019d0f-b725-4695-89c1-94a2bc6b3fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:53.489843 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-6f019d0f-b725-4695-89c1-94a2bc6b3fe0 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:53.491016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-6f019d0f-b725-4695-89c1-94a2bc6b3fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:53.558013 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 504/991] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:53.671223 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796528b8-bb2e-437a-957f-a61e618f9644 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:53.671535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796528b8-bb2e-437a-957f-a61e618f9644 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:53.671803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796528b8-bb2e-437a-957f-a61e618f9644 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:53.673287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 488/992] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:53.678320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267fb1c-7330-412e-91be-45a76fd7867c None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:53.678609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267fb1c-7330-412e-91be-45a76fd7867c None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:53.678881 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267fb1c-7330-412e-91be-45a76fd7867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:53.697784 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-5267fb1c-7330-412e-91be-45a76fd7867c None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:53.698972 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-5267fb1c-7330-412e-91be-45a76fd7867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:53.728193 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:53.766997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 505/993] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:53.822752 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796528b8-bb2e-437a-957f-a61e618f9644 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:53.926391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796528b8-bb2e-437a-957f-a61e618f9644 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:53.960068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19a01f-1b44-429f-81af-a39c412cee57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:53.960726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a01f-1b44-429f-81af-a39c412cee57 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:53.961009 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a01f-1b44-429f-81af-a39c412cee57 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:53.961833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a01f-1b44-429f-81af-a39c412cee57 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:53.962417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19a01f-1b44-429f-81af-a39c412cee57 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:53.963789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19a01f-1b44-429f-81af-a39c412cee57 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-0c19a01f-1b44-429f-81af-a39c412cee57 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:53.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:53.973889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:53.977637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 489/994] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Sep 25 00:42:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:53.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267fb1c-7330-412e-91be-45a76fd7867c None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:54.033854 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19a01f-1b44-429f-81af-a39c412cee57 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:54.050103 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:54.089293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267fb1c-7330-412e-91be-45a76fd7867c None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:54.127636 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce4616-24f6-4166-b68a-d0c1b0769cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:54.128247 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce4616-24f6-4166-b68a-d0c1b0769cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:54.128529 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce4616-24f6-4166-b68a-d0c1b0769cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:54.128830 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce4616-24f6-4166-b68a-d0c1b0769cb9 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:54.129466 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce4616-24f6-4166-b68a-d0c1b0769cb9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:54.129770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce4616-24f6-4166-b68a-d0c1b0769cb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:54.131144 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce4616-24f6-4166-b68a-d0c1b0769cb9 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:54.141110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 506/995] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Sep 25 00:42:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:54.142169 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce4616-24f6-4166-b68a-d0c1b0769cb9 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:54.150929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19a01f-1b44-429f-81af-a39c412cee57 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:54.177410 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:54.187189 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e4951-aa25-46f0-bd01-6f98ec7ffb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:54.187829 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4951-aa25-46f0-bd01-6f98ec7ffb32 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:54.188113 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4951-aa25-46f0-bd01-6f98ec7ffb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:54.188391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4951-aa25-46f0-bd01-6f98ec7ffb32 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:54.189006 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e4951-aa25-46f0-bd01-6f98ec7ffb32 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:54.190375 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e4951-aa25-46f0-bd01-6f98ec7ffb32 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-0c4e4951-aa25-46f0-bd01-6f98ec7ffb32 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:54.200191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:54.201351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:54.202297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 490/996] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:42:54.207017 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e4951-aa25-46f0-bd01-6f98ec7ffb32 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:54.264984 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce4616-24f6-4166-b68a-d0c1b0769cb9 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:54.292596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:54.307150 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166901c2-c891-4cbc-8c5c-b52d612ee0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:54.308005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166901c2-c891-4cbc-8c5c-b52d612ee0de None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:54.308579 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166901c2-c891-4cbc-8c5c-b52d612ee0de None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:54.309329 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166901c2-c891-4cbc-8c5c-b52d612ee0de None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:54.310374 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166901c2-c891-4cbc-8c5c-b52d612ee0de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:54.310825 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166901c2-c891-4cbc-8c5c-b52d612ee0de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:54.313144 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166901c2-c891-4cbc-8c5c-b52d612ee0de None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:54.317589 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e4951-aa25-46f0-bd01-6f98ec7ffb32 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:54.321206 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 507/997] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Sep 25 00:42:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:54.325707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166901c2-c891-4cbc-8c5c-b52d612ee0de None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:54.358129 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4dd18-a7be-42b5-a525-6393e223fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:54.358746 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4dd18-a7be-42b5-a525-6393e223fd55 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:54.359027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4dd18-a7be-42b5-a525-6393e223fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:54.359302 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4dd18-a7be-42b5-a525-6393e223fd55 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:54.359928 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4dd18-a7be-42b5-a525-6393e223fd55 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:54.360229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4dd18-a7be-42b5-a525-6393e223fd55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:54.361983 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4dd18-a7be-42b5-a525-6393e223fd55 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:54.366741 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 491/998] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Sep 25 00:42:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:54.372650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4dd18-a7be-42b5-a525-6393e223fd55 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:54.423726 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:54.432179 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166901c2-c891-4cbc-8c5c-b52d612ee0de None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:54.469659 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f2a28-bd6d-4aef-9b8f-206d8c36f3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:54.470292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f2a28-bd6d-4aef-9b8f-206d8c36f3f9 None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:54.470570 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f2a28-bd6d-4aef-9b8f-206d8c36f3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:54.470843 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f2a28-bd6d-4aef-9b8f-206d8c36f3f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:54.471532 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f2a28-bd6d-4aef-9b8f-206d8c36f3f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:54.473119 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f2a28-bd6d-4aef-9b8f-206d8c36f3f9 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:54.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4dd18-a7be-42b5-a525-6393e223fd55 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:54.493901 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 508/999] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Sep 25 00:42:54 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:42:54.530111 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b97f96-ba07-4d7d-8add-f18ba7cbd201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:54.530647 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b97f96-ba07-4d7d-8add-f18ba7cbd201 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:54.530925 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b97f96-ba07-4d7d-8add-f18ba7cbd201 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:54.531195 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b97f96-ba07-4d7d-8add-f18ba7cbd201 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:54.531838 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b97f96-ba07-4d7d-8add-f18ba7cbd201 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:54.532140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b97f96-ba07-4d7d-8add-f18ba7cbd201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:54.533571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b97f96-ba07-4d7d-8add-f18ba7cbd201 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:54.536043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:54.541518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 492/1000] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Sep 25 00:42:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:54.547015 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f2a28-bd6d-4aef-9b8f-206d8c36f3f9 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:54.575485 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82511a-c886-4bad-8a2a-6c1a13c33d65 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:54.576543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82511a-c886-4bad-8a2a-6c1a13c33d65 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:54.577559 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82511a-c886-4bad-8a2a-6c1a13c33d65 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:54.580068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 493/1001] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:54.585557 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747f888-738d-4af4-b116-1757c651df67 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:54.585840 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747f888-738d-4af4-b116-1757c651df67 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:54.586113 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747f888-738d-4af4-b116-1757c651df67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:54.605787 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-f747f888-738d-4af4-b116-1757c651df67 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:54.607377 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-f747f888-738d-4af4-b116-1757c651df67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:54.661923 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f2a28-bd6d-4aef-9b8f-206d8c36f3f9 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:54.684120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 494/1002] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:54.702087 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4acee-2022-44ac-9d6e-b17d917c21b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:54.702697 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4acee-2022-44ac-9d6e-b17d917c21b4 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:54.702979 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4acee-2022-44ac-9d6e-b17d917c21b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:54.703316 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4acee-2022-44ac-9d6e-b17d917c21b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:54.704022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4acee-2022-44ac-9d6e-b17d917c21b4 None admin] RBAC: Adding query filter params (interface=public, service_id=9e006e3edac74ff193a8b82c840265f5, region_id=RegionOne) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:54.704340 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4acee-2022-44ac-9d6e-b17d917c21b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:54.705746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4acee-2022-44ac-9d6e-b17d917c21b4 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:54.710803 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 509/1003] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Sep 25 00:42:54 2022] GET /identity/v3/endpoints?service_id=9e006e3edac74ff193a8b82c840265f5&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:54.716651 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747f888-738d-4af4-b116-1757c651df67 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:54.829064 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747f888-738d-4af4-b116-1757c651df67 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:54.860060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:54.866814 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c175187-9674-4a22-925a-1e01fa6d8b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:54.867434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c175187-9674-4a22-925a-1e01fa6d8b77 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:54.867711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c175187-9674-4a22-925a-1e01fa6d8b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:54.867984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c175187-9674-4a22-925a-1e01fa6d8b77 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:54.868625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c175187-9674-4a22-925a-1e01fa6d8b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:54.869992 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c175187-9674-4a22-925a-1e01fa6d8b77 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:54.880596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 495/1004] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Sep 25 00:42:54 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:42:54.961513 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4acee-2022-44ac-9d6e-b17d917c21b4 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:54.983315 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:55.074303 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4acee-2022-44ac-9d6e-b17d917c21b4 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:55.109212 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a59e6-7e93-4fcc-8c92-54a3495e76c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:55.109766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a59e6-7e93-4fcc-8c92-54a3495e76c3 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:55.110044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a59e6-7e93-4fcc-8c92-54a3495e76c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:55.110315 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a59e6-7e93-4fcc-8c92-54a3495e76c3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:55.110892 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a59e6-7e93-4fcc-8c92-54a3495e76c3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:55.112263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a59e6-7e93-4fcc-8c92-54a3495e76c3 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-ce5a59e6-7e93-4fcc-8c92-54a3495e76c3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:55.121139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:55.122093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:42:55.125380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 510/1005] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Sep 25 00:42:54 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:55.128699 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c175187-9674-4a22-925a-1e01fa6d8b77 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:55.229882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c175187-9674-4a22-925a-1e01fa6d8b77 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:55.263742 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf181-f1a0-4c93-a54d-1b9fe1606e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:55.264360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf181-f1a0-4c93-a54d-1b9fe1606e7d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:55.264670 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf181-f1a0-4c93-a54d-1b9fe1606e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:55.264946 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf181-f1a0-4c93-a54d-1b9fe1606e7d None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:55.265575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cf181-f1a0-4c93-a54d-1b9fe1606e7d None admin] RBAC: Adding query filter params (name=image) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:55.265879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cf181-f1a0-4c93-a54d-1b9fe1606e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:55.267242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cf181-f1a0-4c93-a54d-1b9fe1606e7d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:55.277648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 496/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:55.278899 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a59e6-7e93-4fcc-8c92-54a3495e76c3 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:55.364950 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:55.384640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a59e6-7e93-4fcc-8c92-54a3495e76c3 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:55.418621 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a605f1-8679-481e-abb2-6704f3c4b6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:55.419237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a605f1-8679-481e-abb2-6704f3c4b6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:55.419517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a605f1-8679-481e-abb2-6704f3c4b6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:55.419792 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a605f1-8679-481e-abb2-6704f3c4b6e9 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:55.420429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a605f1-8679-481e-abb2-6704f3c4b6e9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:55.420762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a605f1-8679-481e-abb2-6704f3c4b6e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:55.422140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a605f1-8679-481e-abb2-6704f3c4b6e9 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:55.432599 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 511/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:56.704863 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d066ca0-6f52-4cc9-8048-5332b0852fe8 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:56.705419 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d066ca0-6f52-4cc9-8048-5332b0852fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:56.705419 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d066ca0-6f52-4cc9-8048-5332b0852fe8 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:56.706765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 497/1008] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:56.711952 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5ec6c-b8be-47a5-90c5-cdfb460caf9b None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:56.712363 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5ec6c-b8be-47a5-90c5-cdfb460caf9b None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:56.712537 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5ec6c-b8be-47a5-90c5-cdfb460caf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:56.731195 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-93d5ec6c-b8be-47a5-90c5-cdfb460caf9b None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:56.732385 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-93d5ec6c-b8be-47a5-90c5-cdfb460caf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:56.799880 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 512/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:56 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:57.020243 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b805ac-e087-4390-96e0-88e723e755d1 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:57.020588 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b805ac-e087-4390-96e0-88e723e755d1 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:57.020766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b805ac-e087-4390-96e0-88e723e755d1 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:57.022208 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 498/1010] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:57.027671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6c19-7019-4685-b2c5-8141e2f7811b None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:57.027962 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6c19-7019-4685-b2c5-8141e2f7811b None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:57.028233 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6c19-7019-4685-b2c5-8141e2f7811b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:57.046933 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-f8ba6c19-7019-4685-b2c5-8141e2f7811b None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:57.048108 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-f8ba6c19-7019-4685-b2c5-8141e2f7811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:57.067596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b805ac-e087-4390-96e0-88e723e755d1 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:57.118910 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 513/1011] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:57 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:57.132642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:57.176635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b805ac-e087-4390-96e0-88e723e755d1 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:57.211277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713e7c5-ef94-4168-8096-dabe284b6f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:57.212057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713e7c5-ef94-4168-8096-dabe284b6f24 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:57.212336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713e7c5-ef94-4168-8096-dabe284b6f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:57.212625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713e7c5-ef94-4168-8096-dabe284b6f24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:57.213785 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713e7c5-ef94-4168-8096-dabe284b6f24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:57.215211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713e7c5-ef94-4168-8096-dabe284b6f24 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:57.217068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 499/1012] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:42:57.223356 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba6c19-7019-4685-b2c5-8141e2f7811b None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:57.234058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:57.324971 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba6c19-7019-4685-b2c5-8141e2f7811b None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:57.358325 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a876d-afe0-4266-9fe8-e2b744078908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:57.358928 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a876d-afe0-4266-9fe8-e2b744078908 None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:57.359204 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a876d-afe0-4266-9fe8-e2b744078908 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:57.359475 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a876d-afe0-4266-9fe8-e2b744078908 None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:57.360121 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a876d-afe0-4266-9fe8-e2b744078908 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:57.361584 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a876d-afe0-4266-9fe8-e2b744078908 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:57.385986 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713e7c5-ef94-4168-8096-dabe284b6f24 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:57.400579 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 514/1013] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Sep 25 00:42:57 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:42:57.498755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713e7c5-ef94-4168-8096-dabe284b6f24 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:57.531169 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:57.540508 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77294a3b-1c4b-4499-8a64-383d13a1aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:57.541683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77294a3b-1c4b-4499-8a64-383d13a1aa45 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:57.542364 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77294a3b-1c4b-4499-8a64-383d13a1aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:57.542637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77294a3b-1c4b-4499-8a64-383d13a1aa45 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:57.543222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77294a3b-1c4b-4499-8a64-383d13a1aa45 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:57.544646 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77294a3b-1c4b-4499-8a64-383d13a1aa45 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-77294a3b-1c4b-4499-8a64-383d13a1aa45 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:42:57.554145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:42:57.555471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:42:57.556516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:42:57.556516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:42:57.556516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:42:57.556516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:42:57.556516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:42:57.556516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:42:57.556516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:42:57.556516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:42:57.556516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:42:57.556516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:42:57.556516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:42:57.556516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:42:57.556516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:42:57.556516 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:42:57.560175 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 500/1014] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:42:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:42:57.561480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a876d-afe0-4266-9fe8-e2b744078908 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:57.594071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e26bd-361a-4b33-a4a6-05883d211dce None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:57.594348 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e26bd-361a-4b33-a4a6-05883d211dce None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:57.594550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e26bd-361a-4b33-a4a6-05883d211dce None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:57.596154 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 501/1015] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:57.601143 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6b9a5-43e9-4963-a304-35c4a77ef629 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:57.601462 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6b9a5-43e9-4963-a304-35c4a77ef629 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:57.601738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6b9a5-43e9-4963-a304-35c4a77ef629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:57.620341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-49f6b9a5-43e9-4963-a304-35c4a77ef629 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:57.621699 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-49f6b9a5-43e9-4963-a304-35c4a77ef629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:57.624049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:57.672056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a876d-afe0-4266-9fe8-e2b744078908 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:57.697100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 502/1016] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:57 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:42:57.711573 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0bd9d-931e-4289-9419-26643164c97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:57.712182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0bd9d-931e-4289-9419-26643164c97c None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:57.712757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0bd9d-931e-4289-9419-26643164c97c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:57.712757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0bd9d-931e-4289-9419-26643164c97c None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:57.713356 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0bd9d-931e-4289-9419-26643164c97c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:57.713656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0bd9d-931e-4289-9419-26643164c97c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:57.715027 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0bd9d-931e-4289-9419-26643164c97c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:57.720200 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 515/1017] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Sep 25 00:42:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:57.725571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6b9a5-43e9-4963-a304-35c4a77ef629 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:57.831990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6b9a5-43e9-4963-a304-35c4a77ef629 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:57.853038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:57.867775 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832ce1e-2210-4976-95d1-c664ac8d9600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:57.868382 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832ce1e-2210-4976-95d1-c664ac8d9600 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:57.868701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832ce1e-2210-4976-95d1-c664ac8d9600 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:57.868973 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832ce1e-2210-4976-95d1-c664ac8d9600 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:57.869596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832ce1e-2210-4976-95d1-c664ac8d9600 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:42:57.869910 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832ce1e-2210-4976-95d1-c664ac8d9600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:57.871268 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832ce1e-2210-4976-95d1-c664ac8d9600 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:57.880737 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 503/1018] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Sep 25 00:42:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:42:57.881723 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0bd9d-931e-4289-9419-26643164c97c None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:57.971131 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832ce1e-2210-4976-95d1-c664ac8d9600 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:42:57.984837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0bd9d-931e-4289-9419-26643164c97c None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:58.006957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:58.022666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a562c3-06e1-4871-b8ad-7cd2d87cf8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:58.023829 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a562c3-06e1-4871-b8ad-7cd2d87cf8c4 None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:58.024130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a562c3-06e1-4871-b8ad-7cd2d87cf8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:58.024380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a562c3-06e1-4871-b8ad-7cd2d87cf8c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:58.025078 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a562c3-06e1-4871-b8ad-7cd2d87cf8c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:58.026488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a562c3-06e1-4871-b8ad-7cd2d87cf8c4 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:58.056591 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 516/1019] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Sep 25 00:42:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:42:58.091716 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832ce1e-2210-4976-95d1-c664ac8d9600 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:42:58.136667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ccc70-0695-4254-85ef-f2d84648b07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:42:58.137303 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ccc70-0695-4254-85ef-f2d84648b07f None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:58.137580 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ccc70-0695-4254-85ef-f2d84648b07f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:58.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ccc70-0695-4254-85ef-f2d84648b07f None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:58.138515 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ccc70-0695-4254-85ef-f2d84648b07f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:42:58.140033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ccc70-0695-4254-85ef-f2d84648b07f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:42:58.164982 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 504/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Sep 25 00:42:57 2022] POST /identity/v3/services => generated 242 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:42:59.610674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671b884-1769-4dc5-a796-b5f4fa4b9258 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:59.611240 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671b884-1769-4dc5-a796-b5f4fa4b9258 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:59.611240 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671b884-1769-4dc5-a796-b5f4fa4b9258 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:59.612612 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 517/1021] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:42:59.618339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f0b82-8856-4bf7-8fca-d0b05f85b91f None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:42:59.618734 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f0b82-8856-4bf7-8fca-d0b05f85b91f None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:42:59.618894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f0b82-8856-4bf7-8fca-d0b05f85b91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:42:59.637285 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-4e6f0b82-8856-4bf7-8fca-d0b05f85b91f None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:42:59.638463 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-4e6f0b82-8856-4bf7-8fca-d0b05f85b91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:42:59.672338 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:42:59.715799 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 505/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:42:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:42:59.987853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671b884-1769-4dc5-a796-b5f4fa4b9258 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:00.090779 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671b884-1769-4dc5-a796-b5f4fa4b9258 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:00.124112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2515904-c547-4ee4-9601-5a27eac826f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:00.124763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515904-c547-4ee4-9601-5a27eac826f6 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:00.125047 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515904-c547-4ee4-9601-5a27eac826f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:00.125319 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515904-c547-4ee4-9601-5a27eac826f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:00.126433 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2515904-c547-4ee4-9601-5a27eac826f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:00.127864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2515904-c547-4ee4-9601-5a27eac826f6 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:00.129676 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 518/1023] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:42:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:00.135310 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f0b82-8856-4bf7-8fca-d0b05f85b91f None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:00.246371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f0b82-8856-4bf7-8fca-d0b05f85b91f None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:00.283707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b8426-fe12-416d-a528-a5047945d9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:00.284320 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b8426-fe12-416d-a528-a5047945d9f0 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:00.284620 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b8426-fe12-416d-a528-a5047945d9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:00.284895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b8426-fe12-416d-a528-a5047945d9f0 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:00.285553 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b8426-fe12-416d-a528-a5047945d9f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:00.286975 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b8426-fe12-416d-a528-a5047945d9f0 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:00.316592 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 506/1024] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:43:00 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:43:00.338086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dca7a-083d-41c0-a661-dd28b726d7a5 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:00.338442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dca7a-083d-41c0-a661-dd28b726d7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:00.338725 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dca7a-083d-41c0-a661-dd28b726d7a5 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:00.340254 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 519/1025] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:00.343678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407642b-9c7f-4e11-b0e0-827329fa6f72 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:00.343960 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407642b-9c7f-4e11-b0e0-827329fa6f72 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:00.344238 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407642b-9c7f-4e11-b0e0-827329fa6f72 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:00.345672 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 507/1026] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:00.346277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabed12-f306-402c-888f-1881e0c4dc1c None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:00.346897 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabed12-f306-402c-888f-1881e0c4dc1c None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:00.347249 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabed12-f306-402c-888f-1881e0c4dc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:00.353329 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe47abb-1f73-495b-b5fe-f4c4d99ba0e6 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:00.354363 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe47abb-1f73-495b-b5fe-f4c4d99ba0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:00.354932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe47abb-1f73-495b-b5fe-f4c4d99ba0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:00.366867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-9cabed12-f306-402c-888f-1881e0c4dc1c None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:00.368090 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-9cabed12-f306-402c-888f-1881e0c4dc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:00.378251 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-0fe47abb-1f73-495b-b5fe-f4c4d99ba0e6 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:00.379494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-0fe47abb-1f73-495b-b5fe-f4c4d99ba0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:00.399768 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:00.416142 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:00.447077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 520/1027] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:43:00.464596 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 508/1028] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:43:00.720278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabed12-f306-402c-888f-1881e0c4dc1c None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:00.728117 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe47abb-1f73-495b-b5fe-f4c4d99ba0e6 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:00.836997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe47abb-1f73-495b-b5fe-f4c4d99ba0e6 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:00.838119 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabed12-f306-402c-888f-1881e0c4dc1c None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:00.875000 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092539c-681b-4a28-b958-72c08cfc6eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:00.875649 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092539c-681b-4a28-b958-72c08cfc6eda None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:00.875899 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092539c-681b-4a28-b958-72c08cfc6eda None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:00.876169 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092539c-681b-4a28-b958-72c08cfc6eda None admin] PATH_INFO: `/v3/services/image` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:00.876777 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092539c-681b-4a28-b958-72c08cfc6eda None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:00.878114 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092539c-681b-4a28-b958-72c08cfc6eda None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:00.879317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5d5d8-6ff9-410b-8605-a552c95848ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:00.880325 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5d5d8-6ff9-410b-8605-a552c95848ee None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:00.880824 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5d5d8-6ff9-410b-8605-a552c95848ee None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:00.881314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5d5d8-6ff9-410b-8605-a552c95848ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-b092539c-681b-4a28-b958-72c08cfc6eda None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:00.887275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:00.888240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:00.889811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 509/1029] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Sep 25 00:43:00 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:43:00.894159 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092539c-681b-4a28-b958-72c08cfc6eda None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:00.894387 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5d5d8-6ff9-410b-8605-a552c95848ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-fbe5d5d8-6ff9-410b-8605-a552c95848ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:43:00.900713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:00.901652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:00.905314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:00.905314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:00.905314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:00.905314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:00.905314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:43:00.905314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:43:00.905314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:43:00.905314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:43:00.905314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:43:00.905314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:43:00.905314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:43:00.905314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:00.905314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 521/1030] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Sep 25 00:43:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:00.908002 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5d5d8-6ff9-410b-8605-a552c95848ee None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:00.913677 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:00.949391 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:01.015346 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092539c-681b-4a28-b958-72c08cfc6eda None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:01.022016 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5d5d8-6ff9-410b-8605-a552c95848ee None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:01.051354 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9a00c-4bd2-409d-b776-0a00787bffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:01.051965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9a00c-4bd2-409d-b776-0a00787bffad None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:01.052351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9a00c-4bd2-409d-b776-0a00787bffad None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:01.052526 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9a00c-4bd2-409d-b776-0a00787bffad None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:01.053229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9a00c-4bd2-409d-b776-0a00787bffad None admin] RBAC: Adding query filter params (name=image) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:01.053535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9a00c-4bd2-409d-b776-0a00787bffad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:01.055480 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9a00c-4bd2-409d-b776-0a00787bffad None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:01.060442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 510/1031] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:01.060846 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ed5b1-ad8b-4884-ad9a-dadb70e680a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:01.061467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed5b1-ad8b-4884-ad9a-dadb70e680a1 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:01.061748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed5b1-ad8b-4884-ad9a-dadb70e680a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:01.062023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed5b1-ad8b-4884-ad9a-dadb70e680a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:01.062702 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ed5b1-ad8b-4884-ad9a-dadb70e680a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:01.063006 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ed5b1-ad8b-4884-ad9a-dadb70e680a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:01.064388 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ed5b1-ad8b-4884-ad9a-dadb70e680a1 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:01.066134 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9a00c-4bd2-409d-b776-0a00787bffad None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:01.077049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 522/1032] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Sep 25 00:43:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:01.080030 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ed5b1-ad8b-4884-ad9a-dadb70e680a1 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:01.162885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:01.184753 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9a00c-4bd2-409d-b776-0a00787bffad None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:01.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:01.190126 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ed5b1-ad8b-4884-ad9a-dadb70e680a1 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:01.222881 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68237ea-0405-4f36-8211-ca4e5215ccf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:01.223500 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68237ea-0405-4f36-8211-ca4e5215ccf8 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:01.223785 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68237ea-0405-4f36-8211-ca4e5215ccf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:01.224060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68237ea-0405-4f36-8211-ca4e5215ccf8 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:01.224758 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68237ea-0405-4f36-8211-ca4e5215ccf8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:01.225064 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68237ea-0405-4f36-8211-ca4e5215ccf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:01.226647 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68237ea-0405-4f36-8211-ca4e5215ccf8 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:01.232185 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 511/1033] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:01.238316 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68237ea-0405-4f36-8211-ca4e5215ccf8 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:01.240082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617abcd-dc41-4214-ba58-7dcfb7527629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:01.240768 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617abcd-dc41-4214-ba58-7dcfb7527629 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:01.241050 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617abcd-dc41-4214-ba58-7dcfb7527629 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:01.241323 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617abcd-dc41-4214-ba58-7dcfb7527629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:01.254314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617abcd-dc41-4214-ba58-7dcfb7527629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:01.255779 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617abcd-dc41-4214-ba58-7dcfb7527629 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-3617abcd-dc41-4214-ba58-7dcfb7527629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:43:01.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:01.274113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:43:01.275874 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:43:01.275874 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:01.275874 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:01.275874 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 523/1034] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:43:01.280881 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617abcd-dc41-4214-ba58-7dcfb7527629 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:01.364411 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68237ea-0405-4f36-8211-ca4e5215ccf8 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:01.395831 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617abcd-dc41-4214-ba58-7dcfb7527629 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:01.401880 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535def18-95df-4f84-9282-7399255ac71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:01.402493 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535def18-95df-4f84-9282-7399255ac71e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:01.402767 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535def18-95df-4f84-9282-7399255ac71e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:01.403114 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535def18-95df-4f84-9282-7399255ac71e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:01.403875 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535def18-95df-4f84-9282-7399255ac71e None admin] RBAC: Adding query filter params (interface=public, service_id=cda4e8d04e0d46a9aa53a208b3067e75, region_id=RegionOne) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:01.404228 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535def18-95df-4f84-9282-7399255ac71e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:01.405638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535def18-95df-4f84-9282-7399255ac71e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:01.410774 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 512/1035] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Sep 25 00:43:01 2022] GET /identity/v3/endpoints?service_id=cda4e8d04e0d46a9aa53a208b3067e75&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:01.416587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535def18-95df-4f84-9282-7399255ac71e None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:01.428326 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:01.436242 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c115919-bc78-43f4-ad62-0c463454aeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:01.437520 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c115919-bc78-43f4-ad62-0c463454aeee None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:01.437775 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c115919-bc78-43f4-ad62-0c463454aeee None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:01.438259 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c115919-bc78-43f4-ad62-0c463454aeee None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:01.439345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c115919-bc78-43f4-ad62-0c463454aeee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:01.439934 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c115919-bc78-43f4-ad62-0c463454aeee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:01.441587 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c115919-bc78-43f4-ad62-0c463454aeee None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:01.455337 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 524/1036] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:01.461430 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c115919-bc78-43f4-ad62-0c463454aeee None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:01.473556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:01.538726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535def18-95df-4f84-9282-7399255ac71e None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:01.572098 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c115919-bc78-43f4-ad62-0c463454aeee None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:01.575848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252119c-82b3-401b-9abc-53ca6c513a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:01.577759 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252119c-82b3-401b-9abc-53ca6c513a51 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:01.577759 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252119c-82b3-401b-9abc-53ca6c513a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:01.577759 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252119c-82b3-401b-9abc-53ca6c513a51 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:01.578356 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252119c-82b3-401b-9abc-53ca6c513a51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:01.579755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252119c-82b3-401b-9abc-53ca6c513a51 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:01.589024 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 513/1037] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Sep 25 00:43:01 2022] GET /identity/v3/services => generated 1957 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:43:01.622519 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302e9be-89c2-47de-89b8-cea35a1354b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:01.623562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302e9be-89c2-47de-89b8-cea35a1354b7 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:01.623944 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302e9be-89c2-47de-89b8-cea35a1354b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:01.624320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302e9be-89c2-47de-89b8-cea35a1354b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:01.633667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302e9be-89c2-47de-89b8-cea35a1354b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:01.635303 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302e9be-89c2-47de-89b8-cea35a1354b7 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-8302e9be-89c2-47de-89b8-cea35a1354b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:43:01.651283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:01.652469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:01.653713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:01.653713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:01.653713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:43:01.653713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:43:01.653713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:43:01.653713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:43:01.653713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:43:01.653713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:43:01.653713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:43:01.653713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:01.655451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 525/1038] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Sep 25 00:43:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:43:01.661238 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252119c-82b3-401b-9abc-53ca6c513a51 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:01.744815 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:01.780307 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252119c-82b3-401b-9abc-53ca6c513a51 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:01.823911 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94714b6-b05a-462d-94ee-8b0d33ac7392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:01.824449 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94714b6-b05a-462d-94ee-8b0d33ac7392 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:01.824752 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94714b6-b05a-462d-94ee-8b0d33ac7392 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:01.825024 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94714b6-b05a-462d-94ee-8b0d33ac7392 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:01.825749 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94714b6-b05a-462d-94ee-8b0d33ac7392 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:01.826048 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94714b6-b05a-462d-94ee-8b0d33ac7392 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:01.827470 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94714b6-b05a-462d-94ee-8b0d33ac7392 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:01.845537 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 514/1039] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Sep 25 00:43:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:01.852584 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302e9be-89c2-47de-89b8-cea35a1354b7 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:01.923024 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:01.955536 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302e9be-89c2-47de-89b8-cea35a1354b7 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:01.989445 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749280d7-6135-4504-af0b-eb84911d771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:01.990051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749280d7-6135-4504-af0b-eb84911d771a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:01.990326 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749280d7-6135-4504-af0b-eb84911d771a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:01.990597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749280d7-6135-4504-af0b-eb84911d771a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:02.059262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749280d7-6135-4504-af0b-eb84911d771a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:02.060760 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749280d7-6135-4504-af0b-eb84911d771a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:02.129986 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:02.166375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 526/1040] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:43:01 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:43:02.167775 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94714b6-b05a-462d-94ee-8b0d33ac7392 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:02.265984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94714b6-b05a-462d-94ee-8b0d33ac7392 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:02.295203 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:02.302092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9df555-d4ee-4b15-b821-3b780e4cc87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:02.302796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9df555-d4ee-4b15-b821-3b780e4cc87c None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:02.303140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9df555-d4ee-4b15-b821-3b780e4cc87c None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:02.303477 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9df555-d4ee-4b15-b821-3b780e4cc87c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:02.313814 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9df555-d4ee-4b15-b821-3b780e4cc87c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:02.315356 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9df555-d4ee-4b15-b821-3b780e4cc87c None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-bf9df555-d4ee-4b15-b821-3b780e4cc87c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:43:02.330242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:02.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:43:02.332569 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:43:02.332569 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:02.332569 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:02.337954 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 515/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:02.338995 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749280d7-6135-4504-af0b-eb84911d771a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:02.438741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749280d7-6135-4504-af0b-eb84911d771a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:02.478774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89d0f7-03bc-4f7d-a776-193e1b721a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:02.479714 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89d0f7-03bc-4f7d-a776-193e1b721a7c None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:02.480171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89d0f7-03bc-4f7d-a776-193e1b721a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:02.480729 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89d0f7-03bc-4f7d-a776-193e1b721a7c None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:02.481570 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89d0f7-03bc-4f7d-a776-193e1b721a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:02.482107 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89d0f7-03bc-4f7d-a776-193e1b721a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:02.483670 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89d0f7-03bc-4f7d-a776-193e1b721a7c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:02.496234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 527/1042] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:02.501601 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9df555-d4ee-4b15-b821-3b780e4cc87c None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:02.555834 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2568fc-5d95-492a-98c1-e082e66ba6af None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:02.556122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2568fc-5d95-492a-98c1-e082e66ba6af None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:02.556392 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2568fc-5d95-492a-98c1-e082e66ba6af None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:02.560590 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 528/1043] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:43:02.562746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f7023-2115-40c4-a2e5-c8783a71a94f None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:02.563033 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f7023-2115-40c4-a2e5-c8783a71a94f None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:02.563310 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f7023-2115-40c4-a2e5-c8783a71a94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:02.581780 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-5d4f7023-2115-40c4-a2e5-c8783a71a94f None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:02.582971 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-5d4f7023-2115-40c4-a2e5-c8783a71a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:02.606811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9df555-d4ee-4b15-b821-3b780e4cc87c None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:02.607571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:02.642458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab61164-3d1c-4eec-bdc9-76c8d509c85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:02.643081 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab61164-3d1c-4eec-bdc9-76c8d509c85d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:02.643384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab61164-3d1c-4eec-bdc9-76c8d509c85d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:02.643654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab61164-3d1c-4eec-bdc9-76c8d509c85d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:02.650642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab61164-3d1c-4eec-bdc9-76c8d509c85d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:02.652182 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab61164-3d1c-4eec-bdc9-76c8d509c85d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:02.653086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 529/1044] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-cab61164-3d1c-4eec-bdc9-76c8d509c85d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:43:02.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:02.668296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:02.669637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:43:02.669637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:43:02.669637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:43:02.669637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:43:02.669637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:43:02.669637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:43:02.669637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:43:02.669637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:02.669637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 516/1045] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:43:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:43:02.676054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f7023-2115-40c4-a2e5-c8783a71a94f None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:02.774937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f7023-2115-40c4-a2e5-c8783a71a94f None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:02.807690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe54c58-2d4e-4025-8e4b-1c1a8a4ea7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:02.808297 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe54c58-2d4e-4025-8e4b-1c1a8a4ea7be None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:02.808595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe54c58-2d4e-4025-8e4b-1c1a8a4ea7be None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:02.808875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe54c58-2d4e-4025-8e4b-1c1a8a4ea7be None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:02.809563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe54c58-2d4e-4025-8e4b-1c1a8a4ea7be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:02.809867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe54c58-2d4e-4025-8e4b-1c1a8a4ea7be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:02.811308 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe54c58-2d4e-4025-8e4b-1c1a8a4ea7be None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:02.831656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 530/1046] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:43:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:02.832830 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab61164-3d1c-4eec-bdc9-76c8d509c85d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:02.878851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:02.926242 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe54c58-2d4e-4025-8e4b-1c1a8a4ea7be None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:02.942541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab61164-3d1c-4eec-bdc9-76c8d509c85d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:02.952044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:02.978862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa06b94-e2cd-433e-a89e-8fb3f260a5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:02.979466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa06b94-e2cd-433e-a89e-8fb3f260a5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:02.979739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa06b94-e2cd-433e-a89e-8fb3f260a5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:02.980009 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa06b94-e2cd-433e-a89e-8fb3f260a5b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:02.980761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa06b94-e2cd-433e-a89e-8fb3f260a5b7 None admin] RBAC: Adding query filter params (role.id=01d4be0e55534d58aea1a76f9441d7f4, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=d494b82a81ca42a69fe7d9efc2f2a251) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:02.981073 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa06b94-e2cd-433e-a89e-8fb3f260a5b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:02.982488 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa06b94-e2cd-433e-a89e-8fb3f260a5b7 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:02.987700 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 517/1047] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:43:02 2022] GET /identity/v3/role_assignments?user.id=d494b82a81ca42a69fe7d9efc2f2a251&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=01d4be0e55534d58aea1a76f9441d7f4 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:03.040031 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe54c58-2d4e-4025-8e4b-1c1a8a4ea7be None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:03.077498 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0df2cf-23c2-4955-9540-4204b36b8021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:03.078169 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df2cf-23c2-4955-9540-4204b36b8021 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:03.078429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df2cf-23c2-4955-9540-4204b36b8021 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:03.078701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df2cf-23c2-4955-9540-4204b36b8021 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:03.090565 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0df2cf-23c2-4955-9540-4204b36b8021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-0a0df2cf-23c2-4955-9540-4204b36b8021 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:43:03.095406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:03.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:03.101569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:03.101569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:03.101569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:03.101569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:03.101569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:43:03.101569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:43:03.101569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:43:03.101569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:43:03.101569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:43:03.101569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:43:03.101569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:03.101569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:03.101569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 531/1048] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:43:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:43:03.103097 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa06b94-e2cd-433e-a89e-8fb3f260a5b7 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:03.216317 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa06b94-e2cd-433e-a89e-8fb3f260a5b7 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:03.223787 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:03.257846 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3677af0-bca4-4e50-b7dd-1f8aeddc8284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:03.258452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3677af0-bca4-4e50-b7dd-1f8aeddc8284 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:03.258729 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3677af0-bca4-4e50-b7dd-1f8aeddc8284 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:03.259036 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3677af0-bca4-4e50-b7dd-1f8aeddc8284 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:03.260354 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3677af0-bca4-4e50-b7dd-1f8aeddc8284 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:03.260951 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3677af0-bca4-4e50-b7dd-1f8aeddc8284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:03.262999 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3677af0-bca4-4e50-b7dd-1f8aeddc8284 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:03.277618 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 518/1049] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:43:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:03.278760 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0df2cf-23c2-4955-9540-4204b36b8021 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:03.360125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:03.381156 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0df2cf-23c2-4955-9540-4204b36b8021 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:03.416496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba0449-44f7-4727-a953-9500ea59c540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:03.417159 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba0449-44f7-4727-a953-9500ea59c540 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:03.417438 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba0449-44f7-4727-a953-9500ea59c540 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:03.417713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba0449-44f7-4727-a953-9500ea59c540 None admin] PATH_INFO: `/v3/users/eb32e64bd12b4921a4153ebc15b5bacb` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:03.431849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba0449-44f7-4727-a953-9500ea59c540 None admin] RBAC: Authorizing `identity:get_user(user_id=eb32e64bd12b4921a4153ebc15b5bacb)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:03.433339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba0449-44f7-4727-a953-9500ea59c540 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:03.439647 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 532/1050] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:03 2022] GET /identity/v3/users/eb32e64bd12b4921a4153ebc15b5bacb => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:03.440838 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3677af0-bca4-4e50-b7dd-1f8aeddc8284 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:03.541682 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3677af0-bca4-4e50-b7dd-1f8aeddc8284 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:03.574487 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff5188-f6ee-47af-8fde-b4d7d3551c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:03.575105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff5188-f6ee-47af-8fde-b4d7d3551c2e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:03.575381 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff5188-f6ee-47af-8fde-b4d7d3551c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:03.575651 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff5188-f6ee-47af-8fde-b4d7d3551c2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:03.614668 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:03.650628 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff5188-f6ee-47af-8fde-b4d7d3551c2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:03.652107 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff5188-f6ee-47af-8fde-b4d7d3551c2e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:03.758279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 519/1051] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:43:03 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 00:43:03.760043 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba0449-44f7-4727-a953-9500ea59c540 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:03.769864 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7903-76f3-4c3e-8371-f6f13dbeef5a None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:03.770160 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7903-76f3-4c3e-8371-f6f13dbeef5a None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:03.770430 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7903-76f3-4c3e-8371-f6f13dbeef5a None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:03.771781 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 520/1052] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:43:03.777336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197ee9-7420-49ec-a9f9-0177e4e3563f None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:03.777842 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197ee9-7420-49ec-a9f9-0177e4e3563f None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:03.778125 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197ee9-7420-49ec-a9f9-0177e4e3563f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:03.795736 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-fb197ee9-7420-49ec-a9f9-0177e4e3563f None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:03.796974 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-fb197ee9-7420-49ec-a9f9-0177e4e3563f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:03.867328 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba0449-44f7-4727-a953-9500ea59c540 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:03.873889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:03.880566 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 521/1053] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:43:03.907439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b4250-7181-413f-9a5f-8080a8d9dbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:03.908077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b4250-7181-413f-9a5f-8080a8d9dbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:03.908363 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b4250-7181-413f-9a5f-8080a8d9dbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:03.908669 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b4250-7181-413f-9a5f-8080a8d9dbd7 None admin] PATH_INFO: `/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:03.909795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b4250-7181-413f-9a5f-8080a8d9dbd7 None admin] RBAC: Authorizing `identity:get_project(project_id=8f6fe18ae32f40eaadc99cf82df7f69c)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:03.911234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b4250-7181-413f-9a5f-8080a8d9dbd7 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:03.913973 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 533/1054] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:43:03 2022] GET /identity/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:03.919239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb197ee9-7420-49ec-a9f9-0177e4e3563f None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:04.020579 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb197ee9-7420-49ec-a9f9-0177e4e3563f None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:04.053609 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710921f-4693-440b-96ff-008dfe4fd3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:04.054742 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710921f-4693-440b-96ff-008dfe4fd3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:04.055020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710921f-4693-440b-96ff-008dfe4fd3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:04.055293 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710921f-4693-440b-96ff-008dfe4fd3f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:04.056009 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710921f-4693-440b-96ff-008dfe4fd3f2 None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=8f6fe18ae32f40eaadc99cf82df7f69c, user.id=eb32e64bd12b4921a4153ebc15b5bacb) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:04.056317 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710921f-4693-440b-96ff-008dfe4fd3f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:04.057790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710921f-4693-440b-96ff-008dfe4fd3f2 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:04.068960 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 522/1055] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:43:03 2022] GET /identity/v3/role_assignments?user.id=eb32e64bd12b4921a4153ebc15b5bacb&scope.project.id=8f6fe18ae32f40eaadc99cf82df7f69c&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:04.146602 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b4250-7181-413f-9a5f-8080a8d9dbd7 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:04.156184 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:04.256480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b4250-7181-413f-9a5f-8080a8d9dbd7 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:04.292361 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88891a-2e3c-4f6a-b91c-e76a2e2e1ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:04.293023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88891a-2e3c-4f6a-b91c-e76a2e2e1ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:04.293301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88891a-2e3c-4f6a-b91c-e76a2e2e1ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:04.293575 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88891a-2e3c-4f6a-b91c-e76a2e2e1ea3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:04.294162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88891a-2e3c-4f6a-b91c-e76a2e2e1ea3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:04.295528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88891a-2e3c-4f6a-b91c-e76a2e2e1ea3 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-0a88891a-2e3c-4f6a-b91c-e76a2e2e1ea3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:04.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:04.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:04.306699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:04.306699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:04.306699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:04.306699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:04.306699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:04.306699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:04.306699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:04.306699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:04.306699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:04.306699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:04.306699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:43:04.306699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:43:04.306699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:43:04.306699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:04.308634 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 534/1056] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Sep 25 00:43:04 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:04.311926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710921f-4693-440b-96ff-008dfe4fd3f2 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:04.375001 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:04.414122 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710921f-4693-440b-96ff-008dfe4fd3f2 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:04.447199 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ab345-49db-48dc-9540-b517396c547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:04.447807 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ab345-49db-48dc-9540-b517396c547d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:04.448085 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ab345-49db-48dc-9540-b517396c547d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:04.448362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ab345-49db-48dc-9540-b517396c547d None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:04.449014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ab345-49db-48dc-9540-b517396c547d None admin] RBAC: Adding query filter params (name=image) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:04.449315 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ab345-49db-48dc-9540-b517396c547d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:04.450665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ab345-49db-48dc-9540-b517396c547d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:04.460215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 523/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:04.461173 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88891a-2e3c-4f6a-b91c-e76a2e2e1ea3 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:04.531221 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:04.563974 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88891a-2e3c-4f6a-b91c-e76a2e2e1ea3 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:04.598881 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079d93b-7aaa-4baa-b5f5-f75dea4ae5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:04.599487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079d93b-7aaa-4baa-b5f5-f75dea4ae5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:04.599762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079d93b-7aaa-4baa-b5f5-f75dea4ae5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:04.600033 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079d93b-7aaa-4baa-b5f5-f75dea4ae5d5 None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:04.601311 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079d93b-7aaa-4baa-b5f5-f75dea4ae5d5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:04.601613 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079d93b-7aaa-4baa-b5f5-f75dea4ae5d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:04.602972 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079d93b-7aaa-4baa-b5f5-f75dea4ae5d5 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:04.612204 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 535/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:04.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ab345-49db-48dc-9540-b517396c547d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:04.715219 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ab345-49db-48dc-9540-b517396c547d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:04.740344 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:04.750263 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893f567-205d-4f89-ae90-12faf15abde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:04.750874 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f567-205d-4f89-ae90-12faf15abde2 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:04.751148 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f567-205d-4f89-ae90-12faf15abde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:04.751416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f567-205d-4f89-ae90-12faf15abde2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:04.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893f567-205d-4f89-ae90-12faf15abde2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:04.753467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893f567-205d-4f89-ae90-12faf15abde2 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:04.780584 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 524/1059] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Sep 25 00:43:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:43:05.149859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041ce3f-bf97-4ab5-80ea-8a0ca38997b1 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:05.150389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041ce3f-bf97-4ab5-80ea-8a0ca38997b1 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:05.150389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041ce3f-bf97-4ab5-80ea-8a0ca38997b1 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:05.151909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 536/1060] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:05.156839 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e341607-e4c5-450b-b456-04648bf8cc4b None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:05.157214 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e341607-e4c5-450b-b456-04648bf8cc4b None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:05.157397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e341607-e4c5-450b-b456-04648bf8cc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:05.175543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-5e341607-e4c5-450b-b456-04648bf8cc4b None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:05.176762 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-5e341607-e4c5-450b-b456-04648bf8cc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:05.264576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 525/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:05.523294 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041ce3f-bf97-4ab5-80ea-8a0ca38997b1 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:05.630478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041ce3f-bf97-4ab5-80ea-8a0ca38997b1 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:05.664611 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d5501-26d4-4520-b86d-deafc8a91fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:05.665246 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d5501-26d4-4520-b86d-deafc8a91fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:05.665524 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d5501-26d4-4520-b86d-deafc8a91fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:05.665795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d5501-26d4-4520-b86d-deafc8a91fb7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:05.667641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:05.677367 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d5501-26d4-4520-b86d-deafc8a91fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-294d5501-26d4-4520-b86d-deafc8a91fb7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:43:05.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:05.683757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:05.684607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:05.684607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:05.684607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:05.684607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:05.684607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:43:05.684607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:43:05.684607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:43:05.684607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:43:05.684607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:43:05.684607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:43:05.684607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:43:05.684607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:05.685987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 537/1062] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Sep 25 00:43:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:05.690208 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e341607-e4c5-450b-b456-04648bf8cc4b None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:05.791405 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e341607-e4c5-450b-b456-04648bf8cc4b None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:05.800520 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:05.829927 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013c896-4bb1-455b-ade0-5c324130b21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:05.830543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013c896-4bb1-455b-ade0-5c324130b21b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:05.830822 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013c896-4bb1-455b-ade0-5c324130b21b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:05.831094 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013c896-4bb1-455b-ade0-5c324130b21b None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:05.831753 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013c896-4bb1-455b-ade0-5c324130b21b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:05.832055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013c896-4bb1-455b-ade0-5c324130b21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:05.833441 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013c896-4bb1-455b-ade0-5c324130b21b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:05.841531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 526/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Sep 25 00:43:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:05.847536 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d5501-26d4-4520-b86d-deafc8a91fb7 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:05.953386 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d5501-26d4-4520-b86d-deafc8a91fb7 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:05.986957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b5598-5bb0-4854-af84-45a387ee93e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:05.987588 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b5598-5bb0-4854-af84-45a387ee93e2 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:05.987864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b5598-5bb0-4854-af84-45a387ee93e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:05.988134 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b5598-5bb0-4854-af84-45a387ee93e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:05.999050 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b5598-5bb0-4854-af84-45a387ee93e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:06.000486 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b5598-5bb0-4854-af84-45a387ee93e2 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-582b5598-5bb0-4854-af84-45a387ee93e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:43:06.014859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:06.015801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:43:06.016737 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:43:06.016737 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:06.016737 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:06.016737 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 538/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:43:06.023696 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013c896-4bb1-455b-ade0-5c324130b21b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:06.124382 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013c896-4bb1-455b-ade0-5c324130b21b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:06.159836 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c91a16-141c-4ef4-857b-7dc65b883507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:06.160465 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91a16-141c-4ef4-857b-7dc65b883507 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:06.160728 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91a16-141c-4ef4-857b-7dc65b883507 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:06.161001 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91a16-141c-4ef4-857b-7dc65b883507 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:06.161632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c91a16-141c-4ef4-857b-7dc65b883507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:06.161931 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c91a16-141c-4ef4-857b-7dc65b883507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:06.163906 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c91a16-141c-4ef4-857b-7dc65b883507 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:06.179874 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 527/1065] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:06.181148 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b5598-5bb0-4854-af84-45a387ee93e2 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:06.229975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:06.234068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0a21b-56fb-4e61-8cb5-580ccfd6dd6b None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:06.234360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0a21b-56fb-4e61-8cb5-580ccfd6dd6b None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:06.234636 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0a21b-56fb-4e61-8cb5-580ccfd6dd6b None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:06.236076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 528/1066] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:06.240790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37e7a9-4454-4bf1-ab4e-244f29f77800 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:06.241094 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37e7a9-4454-4bf1-ab4e-244f29f77800 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:06.241611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37e7a9-4454-4bf1-ab4e-244f29f77800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:06.259488 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-9e37e7a9-4454-4bf1-ab4e-244f29f77800 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:06.260700 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-9e37e7a9-4454-4bf1-ab4e-244f29f77800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:06.285753 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:06.290772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b5598-5bb0-4854-af84-45a387ee93e2 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:06.327324 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23861fdf-3dd8-43e4-9690-eda5a014b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:06.327976 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861fdf-3dd8-43e4-9690-eda5a014b8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:06.328232 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861fdf-3dd8-43e4-9690-eda5a014b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:06.328505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861fdf-3dd8-43e4-9690-eda5a014b8c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:06.333941 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 529/1067] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:43:06.337103 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23861fdf-3dd8-43e4-9690-eda5a014b8c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:06.338548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23861fdf-3dd8-43e4-9690-eda5a014b8c2 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-23861fdf-3dd8-43e4-9690-eda5a014b8c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:43:06.350023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:06.351493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:06.352431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:06.352431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:06.352431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:43:06.352431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:43:06.352431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:43:06.352431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:43:06.352431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:43:06.352431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:43:06.352431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:43:06.352431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:06.353534 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 539/1068] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Sep 25 00:43:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:06.357431 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37e7a9-4454-4bf1-ab4e-244f29f77800 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:06.455707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37e7a9-4454-4bf1-ab4e-244f29f77800 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:06.489517 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c30f58-13ae-42f5-a465-6c93b2d3ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:06.490121 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c30f58-13ae-42f5-a465-6c93b2d3ec60 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:06.490397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c30f58-13ae-42f5-a465-6c93b2d3ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:06.490657 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c30f58-13ae-42f5-a465-6c93b2d3ec60 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:06.491966 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c30f58-13ae-42f5-a465-6c93b2d3ec60 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:06.492265 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c30f58-13ae-42f5-a465-6c93b2d3ec60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:06.493715 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c30f58-13ae-42f5-a465-6c93b2d3ec60 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:06.515242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 530/1069] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Sep 25 00:43:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:06.516783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23861fdf-3dd8-43e4-9690-eda5a014b8c2 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:06.604772 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c30f58-13ae-42f5-a465-6c93b2d3ec60 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:06.620587 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23861fdf-3dd8-43e4-9690-eda5a014b8c2 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:06.628058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:06.630281 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:06.658708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cfe4b-7fe9-4eff-b3a1-efad55f4a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:06.659344 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cfe4b-7fe9-4eff-b3a1-efad55f4a242 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:06.659618 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cfe4b-7fe9-4eff-b3a1-efad55f4a242 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:06.659889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cfe4b-7fe9-4eff-b3a1-efad55f4a242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:06.671970 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cfe4b-7fe9-4eff-b3a1-efad55f4a242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:06.673451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cfe4b-7fe9-4eff-b3a1-efad55f4a242 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-cd4cfe4b-7fe9-4eff-b3a1-efad55f4a242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:43:06.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:06.688758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:43:06.694722 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:43:06.694722 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:06.694722 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:06.694722 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 540/1070] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:06.696623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cfe4b-7fe9-4eff-b3a1-efad55f4a242 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:06.720606 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c30f58-13ae-42f5-a465-6c93b2d3ec60 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:06.755819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbec8e-e0b2-43cb-9946-f8f58b3118e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:06.756449 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbec8e-e0b2-43cb-9946-f8f58b3118e7 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:06.756779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbec8e-e0b2-43cb-9946-f8f58b3118e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:06.757052 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbec8e-e0b2-43cb-9946-f8f58b3118e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:06.767322 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbec8e-e0b2-43cb-9946-f8f58b3118e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-bffbec8e-e0b2-43cb-9946-f8f58b3118e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:43:06.772062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:06.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:06.777642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:06.777642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:06.777642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:06.777642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:06.777642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:43:06.777642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:43:06.777642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:43:06.777642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:43:06.777642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:43:06.777642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:43:06.777642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:06.777642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:06.777642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 531/1071] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:43:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:43:06.779637 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbec8e-e0b2-43cb-9946-f8f58b3118e7 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:06.813358 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cfe4b-7fe9-4eff-b3a1-efad55f4a242 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:06.852851 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed1cb2-fa3a-455c-a7c3-938f31c2c046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:06.853480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed1cb2-fa3a-455c-a7c3-938f31c2c046 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:06.853759 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed1cb2-fa3a-455c-a7c3-938f31c2c046 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:06.854034 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed1cb2-fa3a-455c-a7c3-938f31c2c046 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:06.854696 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed1cb2-fa3a-455c-a7c3-938f31c2c046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:06.855000 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed1cb2-fa3a-455c-a7c3-938f31c2c046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:06.856423 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed1cb2-fa3a-455c-a7c3-938f31c2c046 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:06.868326 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:06.869450 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 541/1072] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:06.875689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed1cb2-fa3a-455c-a7c3-938f31c2c046 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:06.896813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbec8e-e0b2-43cb-9946-f8f58b3118e7 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:06.897860 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:06.940319 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27a0b7-12fa-4b96-bdf7-4a66c4da7189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:06.940956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27a0b7-12fa-4b96-bdf7-4a66c4da7189 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:06.941234 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27a0b7-12fa-4b96-bdf7-4a66c4da7189 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:06.941508 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27a0b7-12fa-4b96-bdf7-4a66c4da7189 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:06.942165 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27a0b7-12fa-4b96-bdf7-4a66c4da7189 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:06.942466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27a0b7-12fa-4b96-bdf7-4a66c4da7189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:06.944091 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27a0b7-12fa-4b96-bdf7-4a66c4da7189 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:06.953082 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 532/1073] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:43:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:06.958861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27a0b7-12fa-4b96-bdf7-4a66c4da7189 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:06.990593 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed1cb2-fa3a-455c-a7c3-938f31c2c046 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:07.023930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46496e7-f2e8-44fd-941a-7ed8ec0413b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:07.024560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46496e7-f2e8-44fd-941a-7ed8ec0413b5 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:07.024865 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46496e7-f2e8-44fd-941a-7ed8ec0413b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:07.025139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46496e7-f2e8-44fd-941a-7ed8ec0413b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:07.031567 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46496e7-f2e8-44fd-941a-7ed8ec0413b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:07.033050 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46496e7-f2e8-44fd-941a-7ed8ec0413b5 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-e46496e7-f2e8-44fd-941a-7ed8ec0413b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:43:07.044708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:07.045719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:07.046605 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:43:07.046605 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:43:07.046605 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:43:07.046605 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:43:07.046605 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:43:07.046605 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:43:07.046605 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:43:07.046605 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:07.046605 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 542/1074] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:43:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:07.047520 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27680000-c31a-461d-9601-5dcdbfeccbaf None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:07.047520 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27680000-c31a-461d-9601-5dcdbfeccbaf None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:07.047763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27680000-c31a-461d-9601-5dcdbfeccbaf None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:07.049241 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 543/1075] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:07.053628 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27680000-c31a-461d-9601-5dcdbfeccbaf None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:07.063197 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27a0b7-12fa-4b96-bdf7-4a66c4da7189 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:07.096621 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113681a-c462-40d2-8dba-01f20925ec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:07.097248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113681a-c462-40d2-8dba-01f20925ec16 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:07.097530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113681a-c462-40d2-8dba-01f20925ec16 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:07.097800 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113681a-c462-40d2-8dba-01f20925ec16 None admin] PATH_INFO: `/v3/users/eb32e64bd12b4921a4153ebc15b5bacb` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:07.098981 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113681a-c462-40d2-8dba-01f20925ec16 None admin] RBAC: Authorizing `identity:get_user(user_id=eb32e64bd12b4921a4153ebc15b5bacb)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:07.101208 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113681a-c462-40d2-8dba-01f20925ec16 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:07.102776 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 533/1076] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:06 2022] GET /identity/v3/users/eb32e64bd12b4921a4153ebc15b5bacb => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:07.105747 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb20281-e27c-4664-ac01-9f8081c681de None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:07.106095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb20281-e27c-4664-ac01-9f8081c681de None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:07.106428 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb20281-e27c-4664-ac01-9f8081c681de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:07.123680 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-6cb20281-e27c-4664-ac01-9f8081c681de None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:07.124893 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-6cb20281-e27c-4664-ac01-9f8081c681de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:07.126787 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:07.132250 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:07.154975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27680000-c31a-461d-9601-5dcdbfeccbaf None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:07.187251 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aaa6f-d41c-469a-8a82-bc76641c8967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:07.187843 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aaa6f-d41c-469a-8a82-bc76641c8967 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:07.188116 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aaa6f-d41c-469a-8a82-bc76641c8967 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:07.188385 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aaa6f-d41c-469a-8a82-bc76641c8967 None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:07.189102 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356aaa6f-d41c-469a-8a82-bc76641c8967 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:07.189404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356aaa6f-d41c-469a-8a82-bc76641c8967 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:07.190821 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356aaa6f-d41c-469a-8a82-bc76641c8967 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:07.193930 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 534/1077] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:07.195194 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb20281-e27c-4664-ac01-9f8081c681de None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:07.203841 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 544/1078] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:07.209571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aaa6f-d41c-469a-8a82-bc76641c8967 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:07.309597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aaa6f-d41c-469a-8a82-bc76641c8967 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:07.312703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb20281-e27c-4664-ac01-9f8081c681de None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:07.345118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5874e-2d9b-4bae-872d-8dda27d56905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:07.345989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5874e-2d9b-4bae-872d-8dda27d56905 None admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:07.346452 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5874e-2d9b-4bae-872d-8dda27d56905 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:07.346725 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5874e-2d9b-4bae-872d-8dda27d56905 None admin] PATH_INFO: `/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/d494b82a81ca42a69fe7d9efc2f2a251/roles/01d4be0e55534d58aea1a76f9441d7f4` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:07.348886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5874e-2d9b-4bae-872d-8dda27d56905 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d5f67cc330446d1b77c741139f68e15, user_id=d494b82a81ca42a69fe7d9efc2f2a251, role_id=01d4be0e55534d58aea1a76f9441d7f4)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:07.350317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5874e-2d9b-4bae-872d-8dda27d56905 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:07.351149 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e4876-5361-495c-a535-982ccdef711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:07.351778 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4876-5361-495c-a535-982ccdef711a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:07.352057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4876-5361-495c-a535-982ccdef711a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:07.352350 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4876-5361-495c-a535-982ccdef711a None admin] PATH_INFO: `/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:07.353460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e4876-5361-495c-a535-982ccdef711a None admin] RBAC: Authorizing `identity:get_project(project_id=8f6fe18ae32f40eaadc99cf82df7f69c)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:07.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e4876-5361-495c-a535-982ccdef711a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:07.356773 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 535/1079] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:43:07 2022] GET /identity/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:07.362620 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e4876-5361-495c-a535-982ccdef711a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:07.363669 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:07.372610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:07.375463 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 545/1080] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:43:07 2022] PUT /identity/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/d494b82a81ca42a69fe7d9efc2f2a251/roles/01d4be0e55534d58aea1a76f9441d7f4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:43:07.469008 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5874e-2d9b-4bae-872d-8dda27d56905 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:07.476762 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e4876-5361-495c-a535-982ccdef711a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:07.515934 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33245588-a57f-4359-a481-78faa74deb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:07.517032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33245588-a57f-4359-a481-78faa74deb7d None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:07.517322 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33245588-a57f-4359-a481-78faa74deb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:07.517595 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33245588-a57f-4359-a481-78faa74deb7d None admin] PATH_INFO: `/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c/users/eb32e64bd12b4921a4153ebc15b5bacb/roles/a6d585feb70946b1b1ebcaece17d26b2` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:07.519972 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33245588-a57f-4359-a481-78faa74deb7d None admin] RBAC: Authorizing `identity:create_grant(project_id=8f6fe18ae32f40eaadc99cf82df7f69c, user_id=eb32e64bd12b4921a4153ebc15b5bacb, role_id=a6d585feb70946b1b1ebcaece17d26b2)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:07.521467 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33245588-a57f-4359-a481-78faa74deb7d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:07.537594 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 536/1081] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:43:07 2022] PUT /identity/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c/users/eb32e64bd12b4921a4153ebc15b5bacb/roles/a6d585feb70946b1b1ebcaece17d26b2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:43:07.595222 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5874e-2d9b-4bae-872d-8dda27d56905 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:07.634816 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786725c6-d9a6-470a-9ebd-d8091ac7ca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:07.635743 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786725c6-d9a6-470a-9ebd-d8091ac7ca9b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:07.636174 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786725c6-d9a6-470a-9ebd-d8091ac7ca9b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:07.636628 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786725c6-d9a6-470a-9ebd-d8091ac7ca9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:07.709296 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:07.715046 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786725c6-d9a6-470a-9ebd-d8091ac7ca9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:07.716631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786725c6-d9a6-470a-9ebd-d8091ac7ca9b None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:07.824279 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 546/1082] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:43:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 00:43:07.829612 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33245588-a57f-4359-a481-78faa74deb7d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:07.906031 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:07.944257 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33245588-a57f-4359-a481-78faa74deb7d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:07.978348 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad01ba2-de76-4e2f-ab5c-24dda4052027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:07.978978 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad01ba2-de76-4e2f-ab5c-24dda4052027 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:07.979253 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad01ba2-de76-4e2f-ab5c-24dda4052027 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:07.979520 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad01ba2-de76-4e2f-ab5c-24dda4052027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:07.989544 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad01ba2-de76-4e2f-ab5c-24dda4052027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:07.991560 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad01ba2-de76-4e2f-ab5c-24dda4052027 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-7ad01ba2-de76-4e2f-ab5c-24dda4052027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:43:08.005970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:08.007095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:43:08.008078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:43:08.008078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:08.008078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:08.008078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 537/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:08.014254 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786725c6-d9a6-470a-9ebd-d8091ac7ca9b None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:08.112690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:08.116948 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786725c6-d9a6-470a-9ebd-d8091ac7ca9b None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:08.152419 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93f830-543a-416a-9e52-dfa5ed869f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:08.153059 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93f830-543a-416a-9e52-dfa5ed869f08 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:08.153374 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93f830-543a-416a-9e52-dfa5ed869f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:08.153615 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93f830-543a-416a-9e52-dfa5ed869f08 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:08.154316 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93f830-543a-416a-9e52-dfa5ed869f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:08.154624 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93f830-543a-416a-9e52-dfa5ed869f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:08.155990 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93f830-543a-416a-9e52-dfa5ed869f08 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:08.176674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 547/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:09.530084 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee71844-9cd2-45da-8653-e93dcab89348 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:09.530634 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee71844-9cd2-45da-8653-e93dcab89348 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:09.530634 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee71844-9cd2-45da-8653-e93dcab89348 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:09.531943 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 538/1085] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:09.536991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c939-1bb2-4644-991f-1b7be9bc2b84 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:09.537380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c939-1bb2-4644-991f-1b7be9bc2b84 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:09.538069 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c939-1bb2-4644-991f-1b7be9bc2b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:09.556943 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-5da1c939-1bb2-4644-991f-1b7be9bc2b84 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:09.558171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-5da1c939-1bb2-4644-991f-1b7be9bc2b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:09.626556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 548/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:09.675248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfca9b-3fff-46c7-9353-fb11e369a00a None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:09.675615 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfca9b-3fff-46c7-9353-fb11e369a00a None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:09.675959 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfca9b-3fff-46c7-9353-fb11e369a00a None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:09.677400 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 539/1087] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:09.683224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865cf24-0278-493a-97dc-bf13a88ff4e2 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:09.683535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865cf24-0278-493a-97dc-bf13a88ff4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:09.683792 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865cf24-0278-493a-97dc-bf13a88ff4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:09.701662 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-d865cf24-0278-493a-97dc-bf13a88ff4e2 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:09.702823 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-d865cf24-0278-493a-97dc-bf13a88ff4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:09.765924 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 549/1088] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:09.891891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfca9b-3fff-46c7-9353-fb11e369a00a None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:09.990663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfca9b-3fff-46c7-9353-fb11e369a00a None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:10.007148 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:10.024692 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b479d-f70d-47bc-ae2c-8acdb556fa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:10.025317 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b479d-f70d-47bc-ae2c-8acdb556fa6b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:10.025600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b479d-f70d-47bc-ae2c-8acdb556fa6b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:10.025875 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b479d-f70d-47bc-ae2c-8acdb556fa6b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:10.031729 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865cf24-0278-493a-97dc-bf13a88ff4e2 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:10.036088 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b479d-f70d-47bc-ae2c-8acdb556fa6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-f33b479d-f70d-47bc-ae2c-8acdb556fa6b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:43:10.041484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:10.042448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:10.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:10.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:10.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:10.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:10.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:43:10.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:43:10.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:43:10.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:43:10.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:43:10.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:43:10.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:43:10.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:10.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 540/1089] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Sep 25 00:43:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:10.048279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b479d-f70d-47bc-ae2c-8acdb556fa6b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:10.052716 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:10.132115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865cf24-0278-493a-97dc-bf13a88ff4e2 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:10.148034 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b479d-f70d-47bc-ae2c-8acdb556fa6b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:10.165039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff9448-1f5c-40a8-9838-b08512f7adbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:10.165662 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff9448-1f5c-40a8-9838-b08512f7adbc None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:10.165938 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff9448-1f5c-40a8-9838-b08512f7adbc None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:10.166207 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff9448-1f5c-40a8-9838-b08512f7adbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:10.176363 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff9448-1f5c-40a8-9838-b08512f7adbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:43:10.180959 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ff45c-811a-4d41-9994-877447d35ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-48ff9448-1f5c-40a8-9838-b08512f7adbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:43:10.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:10.182292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:10.183129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:10.183129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:10.183129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:10.183129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:10.183129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:43:10.183129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:43:10.183129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:43:10.183129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:43:10.183129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:43:10.183129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:43:10.183129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:10.183129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:10.183769 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff45c-811a-4d41-9994-877447d35ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:10.183769 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff45c-811a-4d41-9994-877447d35ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:10.183769 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff45c-811a-4d41-9994-877447d35ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:10.183973 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 550/1090] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:43:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:43:10.184058 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ff45c-811a-4d41-9994-877447d35ae6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:10.184058 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ff45c-811a-4d41-9994-877447d35ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:10.184481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ff45c-811a-4d41-9994-877447d35ae6 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:10.188205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff9448-1f5c-40a8-9838-b08512f7adbc None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:10.197789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 541/1091] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Sep 25 00:43:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:10.198775 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ff45c-811a-4d41-9994-877447d35ae6 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:10.242909 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:10.272635 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:10.294605 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff9448-1f5c-40a8-9838-b08512f7adbc None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:10.299617 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ff45c-811a-4d41-9994-877447d35ae6 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:10.331902 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff078ba-24ee-4941-86f8-86275075d86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:10.332586 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff078ba-24ee-4941-86f8-86275075d86b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:10.332862 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff078ba-24ee-4941-86f8-86275075d86b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:10.333159 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff078ba-24ee-4941-86f8-86275075d86b None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:10.333811 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff078ba-24ee-4941-86f8-86275075d86b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:10.334116 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff078ba-24ee-4941-86f8-86275075d86b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:10.335480 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35c255-54a7-480d-8cf0-009353bdf5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:10.336105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35c255-54a7-480d-8cf0-009353bdf5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:10.336196 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff078ba-24ee-4941-86f8-86275075d86b None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:10.336379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35c255-54a7-480d-8cf0-009353bdf5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:10.336685 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35c255-54a7-480d-8cf0-009353bdf5a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:10.344724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 551/1092] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:43:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:10.347100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35c255-54a7-480d-8cf0-009353bdf5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:10.348535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35c255-54a7-480d-8cf0-009353bdf5a1 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:10.350584 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff078ba-24ee-4941-86f8-86275075d86b None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-bd35c255-54a7-480d-8cf0-009353bdf5a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:43:10.362460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:10.363434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:43:10.364366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:43:10.364366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:10.364366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:10.364366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 542/1093] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:10.369088 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35c255-54a7-480d-8cf0-009353bdf5a1 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:10.450896 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff078ba-24ee-4941-86f8-86275075d86b None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:10.461267 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:10.470559 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35c255-54a7-480d-8cf0-009353bdf5a1 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:10.484072 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63068be3-f0e0-4e03-a9b4-499838c8613c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:10.484728 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63068be3-f0e0-4e03-a9b4-499838c8613c None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:10.485006 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63068be3-f0e0-4e03-a9b4-499838c8613c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:10.485276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63068be3-f0e0-4e03-a9b4-499838c8613c None admin] PATH_INFO: `/v3/users/eb32e64bd12b4921a4153ebc15b5bacb` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:10.486406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63068be3-f0e0-4e03-a9b4-499838c8613c None admin] RBAC: Authorizing `identity:get_user(user_id=eb32e64bd12b4921a4153ebc15b5bacb)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:10.487829 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63068be3-f0e0-4e03-a9b4-499838c8613c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:10.489418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 552/1094] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:10 2022] GET /identity/v3/users/eb32e64bd12b4921a4153ebc15b5bacb => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:10.495138 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63068be3-f0e0-4e03-a9b4-499838c8613c None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:10.503287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13c385-a094-44bf-a2a6-f83f8542dc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:10.503897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13c385-a094-44bf-a2a6-f83f8542dc89 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:10.504361 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13c385-a094-44bf-a2a6-f83f8542dc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:10.504533 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13c385-a094-44bf-a2a6-f83f8542dc89 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:10.505105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13c385-a094-44bf-a2a6-f83f8542dc89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:10.505405 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13c385-a094-44bf-a2a6-f83f8542dc89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:10.506856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:10.507365 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13c385-a094-44bf-a2a6-f83f8542dc89 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:10.519197 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 543/1095] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:10.525266 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13c385-a094-44bf-a2a6-f83f8542dc89 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:10.596136 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63068be3-f0e0-4e03-a9b4-499838c8613c None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:10.621492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13c385-a094-44bf-a2a6-f83f8542dc89 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:10.629334 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ea719-2513-4732-aafd-67f22e0b138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:10.629933 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ea719-2513-4732-aafd-67f22e0b138e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:10.630211 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ea719-2513-4732-aafd-67f22e0b138e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:10.630486 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ea719-2513-4732-aafd-67f22e0b138e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:10.655054 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae426a5-948d-425f-a4ed-828498e086ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:10.655669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae426a5-948d-425f-a4ed-828498e086ff None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:10.655948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae426a5-948d-425f-a4ed-828498e086ff None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:10.656218 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae426a5-948d-425f-a4ed-828498e086ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:10.663063 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae426a5-948d-425f-a4ed-828498e086ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:10.664488 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae426a5-948d-425f-a4ed-828498e086ff None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-bae426a5-948d-425f-a4ed-828498e086ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:43:10.675703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:10.676913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:10.678648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:10.678648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:10.678648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:43:10.678648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:43:10.678648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:43:10.678648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:43:10.678648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:43:10.678648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:43:10.678648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:43:10.678648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:10.678648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 544/1096] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Sep 25 00:43:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:43:10.682913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae426a5-948d-425f-a4ed-828498e086ff None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:10.697778 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:10.699092 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ea719-2513-4732-aafd-67f22e0b138e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:10.700626 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ea719-2513-4732-aafd-67f22e0b138e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:10.710202 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:10.788642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae426a5-948d-425f-a4ed-828498e086ff None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:10.806283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 553/1097] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:43:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 00:43:10.807403 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ea719-2513-4732-aafd-67f22e0b138e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:10.826830 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0defcfd-38e0-48e5-80fe-90013626efa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:10.827435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0defcfd-38e0-48e5-80fe-90013626efa8 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:10.827711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0defcfd-38e0-48e5-80fe-90013626efa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:10.827980 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0defcfd-38e0-48e5-80fe-90013626efa8 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:10.828734 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0defcfd-38e0-48e5-80fe-90013626efa8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:10.829031 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0defcfd-38e0-48e5-80fe-90013626efa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:10.830547 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0defcfd-38e0-48e5-80fe-90013626efa8 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:10.847076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 545/1098] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Sep 25 00:43:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:10.852862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0defcfd-38e0-48e5-80fe-90013626efa8 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:10.905043 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ea719-2513-4732-aafd-67f22e0b138e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:10.914502 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:10.921328 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:10.939359 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aac969-3a93-43bd-983d-eafd91b879c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:10.939982 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac969-3a93-43bd-983d-eafd91b879c7 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:10.940260 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac969-3a93-43bd-983d-eafd91b879c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:10.940530 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac969-3a93-43bd-983d-eafd91b879c7 None admin] PATH_INFO: `/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:10.941671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aac969-3a93-43bd-983d-eafd91b879c7 None admin] RBAC: Authorizing `identity:get_project(project_id=8f6fe18ae32f40eaadc99cf82df7f69c)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:10.943359 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aac969-3a93-43bd-983d-eafd91b879c7 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:10.945022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 554/1099] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:43:10 2022] GET /identity/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:10.950898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aac969-3a93-43bd-983d-eafd91b879c7 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:10.957278 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0defcfd-38e0-48e5-80fe-90013626efa8 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:10.991352 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acdc15-f9bf-4a89-83ee-af0f77fc5d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:10.991892 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acdc15-f9bf-4a89-83ee-af0f77fc5d45 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:10.992171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acdc15-f9bf-4a89-83ee-af0f77fc5d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:10.992445 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acdc15-f9bf-4a89-83ee-af0f77fc5d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:11.048380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aac969-3a93-43bd-983d-eafd91b879c7 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:11.059717 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acdc15-f9bf-4a89-83ee-af0f77fc5d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:11.061186 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acdc15-f9bf-4a89-83ee-af0f77fc5d45 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:11.081499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc01c2-69ac-4ade-9d19-441e73a0d969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:11.082089 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc01c2-69ac-4ade-9d19-441e73a0d969 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:11.082362 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc01c2-69ac-4ade-9d19-441e73a0d969 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:11.082630 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc01c2-69ac-4ade-9d19-441e73a0d969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:11.083338 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc01c2-69ac-4ade-9d19-441e73a0d969 None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=8f6fe18ae32f40eaadc99cf82df7f69c, user.id=eb32e64bd12b4921a4153ebc15b5bacb) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:11.083641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc01c2-69ac-4ade-9d19-441e73a0d969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:11.085113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc01c2-69ac-4ade-9d19-441e73a0d969 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:11.090841 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 555/1100] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:43:10 2022] GET /identity/v3/role_assignments?user.id=eb32e64bd12b4921a4153ebc15b5bacb&scope.project.id=8f6fe18ae32f40eaadc99cf82df7f69c&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:11.135884 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:11.169813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 546/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:43:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 00:43:11.175720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc01c2-69ac-4ade-9d19-441e73a0d969 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:11.219521 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:11.281113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc01c2-69ac-4ade-9d19-441e73a0d969 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:11.315084 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6aaae-f349-43f1-9574-1a32b064531d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:11.315711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6aaae-f349-43f1-9574-1a32b064531d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:11.315985 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6aaae-f349-43f1-9574-1a32b064531d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:11.316254 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6aaae-f349-43f1-9574-1a32b064531d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:11.326794 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6aaae-f349-43f1-9574-1a32b064531d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:11.328224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6aaae-f349-43f1-9574-1a32b064531d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-d8a6aaae-f349-43f1-9574-1a32b064531d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:43:11.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:11.343592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:43:11.344494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:43:11.344494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:11.344494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:11.344494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 556/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:11.349206 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acdc15-f9bf-4a89-83ee-af0f77fc5d45 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:11.443959 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acdc15-f9bf-4a89-83ee-af0f77fc5d45 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:11.477354 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1548700-ef54-428e-9a7a-4e9b4fba2d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:11.477954 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548700-ef54-428e-9a7a-4e9b4fba2d54 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:11.478227 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548700-ef54-428e-9a7a-4e9b4fba2d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:11.478495 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548700-ef54-428e-9a7a-4e9b4fba2d54 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:11.479127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1548700-ef54-428e-9a7a-4e9b4fba2d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:11.479427 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1548700-ef54-428e-9a7a-4e9b4fba2d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:11.480806 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1548700-ef54-428e-9a7a-4e9b4fba2d54 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:11.491718 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 547/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:11.497328 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6aaae-f349-43f1-9574-1a32b064531d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:11.586934 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:11.596136 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6aaae-f349-43f1-9574-1a32b064531d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:11.629003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed53f9c-2fdc-41ac-84f1-9e9b1cf9d4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:11.629627 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed53f9c-2fdc-41ac-84f1-9e9b1cf9d4ec None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:11.629885 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed53f9c-2fdc-41ac-84f1-9e9b1cf9d4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:11.630154 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed53f9c-2fdc-41ac-84f1-9e9b1cf9d4ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:11.637179 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed53f9c-2fdc-41ac-84f1-9e9b1cf9d4ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:11.638618 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed53f9c-2fdc-41ac-84f1-9e9b1cf9d4ec None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-8ed53f9c-2fdc-41ac-84f1-9e9b1cf9d4ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:43:11.650215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:11.651236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:11.652505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:43:11.652505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:43:11.652505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:43:11.652505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:43:11.652505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:43:11.652505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:43:11.652505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:43:11.652505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:11.652505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 557/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:43:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:11.657119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1548700-ef54-428e-9a7a-4e9b4fba2d54 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:11.686598 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:11.754728 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1548700-ef54-428e-9a7a-4e9b4fba2d54 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:11.788158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1ab79-bbc7-4d09-ac03-0951bcae56ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:11.788830 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1ab79-bbc7-4d09-ac03-0951bcae56ca None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:11.789108 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1ab79-bbc7-4d09-ac03-0951bcae56ca None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:11.789811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1ab79-bbc7-4d09-ac03-0951bcae56ca None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:11.790506 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1ab79-bbc7-4d09-ac03-0951bcae56ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:11.790817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1ab79-bbc7-4d09-ac03-0951bcae56ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:11.792241 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1ab79-bbc7-4d09-ac03-0951bcae56ca None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:11.804132 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 548/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:11.810205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed53f9c-2fdc-41ac-84f1-9e9b1cf9d4ec None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:11.911316 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed53f9c-2fdc-41ac-84f1-9e9b1cf9d4ec None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:11.944298 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f473884-2a17-46f7-9864-27f39c03c5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:11.944935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f473884-2a17-46f7-9864-27f39c03c5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:11.945216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f473884-2a17-46f7-9864-27f39c03c5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:11.945492 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f473884-2a17-46f7-9864-27f39c03c5f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:11.946215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f473884-2a17-46f7-9864-27f39c03c5f6 None admin] RBAC: Adding query filter params (role.id=01d4be0e55534d58aea1a76f9441d7f4, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=d494b82a81ca42a69fe7d9efc2f2a251) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:11.946525 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f473884-2a17-46f7-9864-27f39c03c5f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:11.948091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f473884-2a17-46f7-9864-27f39c03c5f6 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:11.953827 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 558/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:43:11 2022] GET /identity/v3/role_assignments?user.id=d494b82a81ca42a69fe7d9efc2f2a251&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=01d4be0e55534d58aea1a76f9441d7f4 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:13.249020 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ee606-a183-4eab-b12d-273a13270431 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:13.249575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ee606-a183-4eab-b12d-273a13270431 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:13.249575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ee606-a183-4eab-b12d-273a13270431 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:13.250969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 549/1107] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:13.255990 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd818dc-e799-4ad3-99fe-303e22252407 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:13.256392 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd818dc-e799-4ad3-99fe-303e22252407 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:13.256563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd818dc-e799-4ad3-99fe-303e22252407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:13.274421 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-0dd818dc-e799-4ad3-99fe-303e22252407 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:13.275604 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-0dd818dc-e799-4ad3-99fe-303e22252407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:13.285882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:13.340658 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 559/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:13.607462 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ee606-a183-4eab-b12d-273a13270431 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:13.693983 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:13.704512 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ee606-a183-4eab-b12d-273a13270431 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:13.737458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e56e2-1ff6-449a-86d9-1259265e1d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:13.738065 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e56e2-1ff6-449a-86d9-1259265e1d6c None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:13.738339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e56e2-1ff6-449a-86d9-1259265e1d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:13.738609 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e56e2-1ff6-449a-86d9-1259265e1d6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:13.739688 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e56e2-1ff6-449a-86d9-1259265e1d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:13.741171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e56e2-1ff6-449a-86d9-1259265e1d6c None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:13.742693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 550/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:13.748275 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd818dc-e799-4ad3-99fe-303e22252407 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:13.844318 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd818dc-e799-4ad3-99fe-303e22252407 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:13.877484 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473a22b-2920-453d-ae08-1f9fc39dcda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:13.878028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a22b-2920-453d-ae08-1f9fc39dcda8 None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:13.878306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a22b-2920-453d-ae08-1f9fc39dcda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:13.878581 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a22b-2920-453d-ae08-1f9fc39dcda8 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:13.879227 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473a22b-2920-453d-ae08-1f9fc39dcda8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:13.880685 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473a22b-2920-453d-ae08-1f9fc39dcda8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:13.906391 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 560/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:43:13 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:43:16.057140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d42e9-6c6a-4626-97ec-5f7da799f55d None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:16.057690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d42e9-6c6a-4626-97ec-5f7da799f55d None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:16.057690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d42e9-6c6a-4626-97ec-5f7da799f55d None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:16.059016 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 551/1111] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:16.064124 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea7c7a-59e2-46af-a9bb-7790361e0b21 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:16.064538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea7c7a-59e2-46af-a9bb-7790361e0b21 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:16.064701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea7c7a-59e2-46af-a9bb-7790361e0b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:16.071178 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:16.085106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-efea7c7a-59e2-46af-a9bb-7790361e0b21 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:16.086221 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-efea7c7a-59e2-46af-a9bb-7790361e0b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:16.149972 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 561/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:16.420747 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d42e9-6c6a-4626-97ec-5f7da799f55d None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:16.520154 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d42e9-6c6a-4626-97ec-5f7da799f55d None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:16.553273 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa5740-31f9-4914-ad73-7ed028b0ad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:16.553886 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa5740-31f9-4914-ad73-7ed028b0ad97 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:16.554162 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa5740-31f9-4914-ad73-7ed028b0ad97 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:16.554430 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa5740-31f9-4914-ad73-7ed028b0ad97 None admin] PATH_INFO: `/v3/roles/3ebdb28c195f447294810f1033bb8e62` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:16.555806 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa5740-31f9-4914-ad73-7ed028b0ad97 None admin] RBAC: Authorizing `identity:get_role(role_id=3ebdb28c195f447294810f1033bb8e62)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:16.557262 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa5740-31f9-4914-ad73-7ed028b0ad97 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:16.558569 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 552/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:16 2022] GET /identity/v3/roles/3ebdb28c195f447294810f1033bb8e62 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:16.564404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea7c7a-59e2-46af-a9bb-7790361e0b21 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:16.661952 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea7c7a-59e2-46af-a9bb-7790361e0b21 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:16.689673 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:16.695360 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa751fa-d0cd-4947-aa00-7f96c9bf2c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:16.695979 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa751fa-d0cd-4947-aa00-7f96c9bf2c8c None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:16.696255 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa751fa-d0cd-4947-aa00-7f96c9bf2c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:16.696527 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa751fa-d0cd-4947-aa00-7f96c9bf2c8c None admin] PATH_INFO: `/v3/users/37a9355cdff646a594ecf86fb5c65367` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:16.708968 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa751fa-d0cd-4947-aa00-7f96c9bf2c8c None admin] RBAC: Authorizing `identity:get_user(user_id=37a9355cdff646a594ecf86fb5c65367)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:16.710394 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa751fa-d0cd-4947-aa00-7f96c9bf2c8c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:16.711956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 562/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:16 2022] GET /identity/v3/users/37a9355cdff646a594ecf86fb5c65367 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:16.717792 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa5740-31f9-4914-ad73-7ed028b0ad97 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:16.744182 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:16.812505 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa5740-31f9-4914-ad73-7ed028b0ad97 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:16.845159 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c3028-5b85-4c9e-942f-4e5c59c6a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:16.845755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c3028-5b85-4c9e-942f-4e5c59c6a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:16.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c3028-5b85-4c9e-942f-4e5c59c6a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:16.846326 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c3028-5b85-4c9e-942f-4e5c59c6a6a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:16.909397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c3028-5b85-4c9e-942f-4e5c59c6a6a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:16.910843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c3028-5b85-4c9e-942f-4e5c59c6a6a5 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:16.936512 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:17.008895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 553/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:43:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:43:17.014526 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa751fa-d0cd-4947-aa00-7f96c9bf2c8c None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:17.111109 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa751fa-d0cd-4947-aa00-7f96c9bf2c8c None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:17.144767 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2224b5-375e-483d-97d4-72e0d58771a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:17.145380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2224b5-375e-483d-97d4-72e0d58771a3 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:17.145653 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2224b5-375e-483d-97d4-72e0d58771a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:17.145923 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2224b5-375e-483d-97d4-72e0d58771a3 None admin] PATH_INFO: `/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:17.147019 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2224b5-375e-483d-97d4-72e0d58771a3 None admin] RBAC: Authorizing `identity:get_project(project_id=8f6fe18ae32f40eaadc99cf82df7f69c)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:17.148437 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2224b5-375e-483d-97d4-72e0d58771a3 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:17.150043 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 563/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:43:17 2022] GET /identity/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:17.156163 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c3028-5b85-4c9e-942f-4e5c59c6a6a5 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:17.250249 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c3028-5b85-4c9e-942f-4e5c59c6a6a5 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:17.274671 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:17.283335 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464f2ad-be96-4712-a421-7cd81a776302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:17.283927 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f2ad-be96-4712-a421-7cd81a776302 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:17.284204 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f2ad-be96-4712-a421-7cd81a776302 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:17.284475 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f2ad-be96-4712-a421-7cd81a776302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:17.285222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464f2ad-be96-4712-a421-7cd81a776302 None admin] RBAC: Adding query filter params (role.id=3ebdb28c195f447294810f1033bb8e62, scope.project.id=8f6fe18ae32f40eaadc99cf82df7f69c, user.id=37a9355cdff646a594ecf86fb5c65367) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:17.285531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464f2ad-be96-4712-a421-7cd81a776302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:17.287560 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464f2ad-be96-4712-a421-7cd81a776302 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:17.292682 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 554/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:43:17 2022] GET /identity/v3/role_assignments?user.id=37a9355cdff646a594ecf86fb5c65367&scope.project.id=8f6fe18ae32f40eaadc99cf82df7f69c&role.id=3ebdb28c195f447294810f1033bb8e62 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:19.392166 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815e8cb-a2d0-4c71-acf0-15c2f7de5de3 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:19.392810 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815e8cb-a2d0-4c71-acf0-15c2f7de5de3 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:19.392810 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815e8cb-a2d0-4c71-acf0-15c2f7de5de3 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:19.394085 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 564/1118] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:19.399835 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dae63b-5d26-48cb-8114-c4eb4c4cac52 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:19.400207 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dae63b-5d26-48cb-8114-c4eb4c4cac52 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:19.400379 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dae63b-5d26-48cb-8114-c4eb4c4cac52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:19.417929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-79dae63b-5d26-48cb-8114-c4eb4c4cac52 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:19.419100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-79dae63b-5d26-48cb-8114-c4eb4c4cac52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:19.482786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 555/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:19.747330 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815e8cb-a2d0-4c71-acf0-15c2f7de5de3 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:19.804984 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:19.847618 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815e8cb-a2d0-4c71-acf0-15c2f7de5de3 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:19.880893 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c8d7-1250-4a45-bccb-aaef176a979d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:19.881515 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c8d7-1250-4a45-bccb-aaef176a979d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:19.881794 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c8d7-1250-4a45-bccb-aaef176a979d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:19.882065 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c8d7-1250-4a45-bccb-aaef176a979d None admin] PATH_INFO: `/v3/roles/3ebdb28c195f447294810f1033bb8e62` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:19.883462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257c8d7-1250-4a45-bccb-aaef176a979d None admin] RBAC: Authorizing `identity:get_role(role_id=3ebdb28c195f447294810f1033bb8e62)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:19.884863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257c8d7-1250-4a45-bccb-aaef176a979d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:19.886169 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 565/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:19 2022] GET /identity/v3/roles/3ebdb28c195f447294810f1033bb8e62 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:19.892039 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dae63b-5d26-48cb-8114-c4eb4c4cac52 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:19.985033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dae63b-5d26-48cb-8114-c4eb4c4cac52 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:20.005307 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:20.019019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88367da8-f1d8-401a-b60c-4392d6263734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:20.019667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88367da8-f1d8-401a-b60c-4392d6263734 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:20.019948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88367da8-f1d8-401a-b60c-4392d6263734 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:20.020220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88367da8-f1d8-401a-b60c-4392d6263734 None admin] PATH_INFO: `/v3/users/37a9355cdff646a594ecf86fb5c65367` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:20.021370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88367da8-f1d8-401a-b60c-4392d6263734 None admin] RBAC: Authorizing `identity:get_user(user_id=37a9355cdff646a594ecf86fb5c65367)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:20.022784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88367da8-f1d8-401a-b60c-4392d6263734 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:20.024345 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 556/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:19 2022] GET /identity/v3/users/37a9355cdff646a594ecf86fb5c65367 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:20.030209 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c8d7-1250-4a45-bccb-aaef176a979d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:20.134984 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c8d7-1250-4a45-bccb-aaef176a979d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:20.160205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:20.169564 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ef745-14d6-4eb1-8553-8845a898020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:20.170192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef745-14d6-4eb1-8553-8845a898020d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:20.170473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef745-14d6-4eb1-8553-8845a898020d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:20.170749 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef745-14d6-4eb1-8553-8845a898020d None admin] PATH_INFO: `/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:20.171863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ef745-14d6-4eb1-8553-8845a898020d None admin] RBAC: Authorizing `identity:get_project(project_id=8f6fe18ae32f40eaadc99cf82df7f69c)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:20.173319 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ef745-14d6-4eb1-8553-8845a898020d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:20.174917 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 566/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:43:20 2022] GET /identity/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:20.181401 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88367da8-f1d8-401a-b60c-4392d6263734 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:20.281760 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88367da8-f1d8-401a-b60c-4392d6263734 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:20.315362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef45abc-2d99-43fb-8fd9-3499397bba5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:20.316011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef45abc-2d99-43fb-8fd9-3499397bba5d None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:20.316290 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef45abc-2d99-43fb-8fd9-3499397bba5d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:20.316584 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef45abc-2d99-43fb-8fd9-3499397bba5d None admin] PATH_INFO: `/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c/users/37a9355cdff646a594ecf86fb5c65367/roles/3ebdb28c195f447294810f1033bb8e62` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:20.318970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef45abc-2d99-43fb-8fd9-3499397bba5d None admin] RBAC: Authorizing `identity:create_grant(project_id=8f6fe18ae32f40eaadc99cf82df7f69c, user_id=37a9355cdff646a594ecf86fb5c65367, role_id=3ebdb28c195f447294810f1033bb8e62)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:20.320392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef45abc-2d99-43fb-8fd9-3499397bba5d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:20.332484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 557/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:43:20 2022] PUT /identity/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c/users/37a9355cdff646a594ecf86fb5c65367/roles/3ebdb28c195f447294810f1033bb8e62 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:43:22.464463 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d1e0e-c066-47e2-b4d6-ea87f60c6a3a None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:22.465009 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d1e0e-c066-47e2-b4d6-ea87f60c6a3a None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:22.465159 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d1e0e-c066-47e2-b4d6-ea87f60c6a3a None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:22.466522 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 567/1124] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:22.471644 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36cf12-fd00-49a5-aad8-35982f159cbc None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:22.472041 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36cf12-fd00-49a5-aad8-35982f159cbc None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:22.472184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36cf12-fd00-49a5-aad8-35982f159cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:22.489763 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-ac36cf12-fd00-49a5-aad8-35982f159cbc None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:22.490925 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-ac36cf12-fd00-49a5-aad8-35982f159cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:22.532925 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:22.555817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 558/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:43:22.824752 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d1e0e-c066-47e2-b4d6-ea87f60c6a3a None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:22.921223 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d1e0e-c066-47e2-b4d6-ea87f60c6a3a None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:22.953699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f2190-609f-4056-9b0e-6f43ab9f0073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:22.954315 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f2190-609f-4056-9b0e-6f43ab9f0073 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:22.954593 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f2190-609f-4056-9b0e-6f43ab9f0073 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:22.954866 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f2190-609f-4056-9b0e-6f43ab9f0073 None admin] PATH_INFO: `/v3/roles/3ebdb28c195f447294810f1033bb8e62` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:22.956290 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f2190-609f-4056-9b0e-6f43ab9f0073 None admin] RBAC: Authorizing `identity:get_role(role_id=3ebdb28c195f447294810f1033bb8e62)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:22.957633 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f2190-609f-4056-9b0e-6f43ab9f0073 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:22.958937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 568/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:22 2022] GET /identity/v3/roles/3ebdb28c195f447294810f1033bb8e62 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:22.964574 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36cf12-fd00-49a5-aad8-35982f159cbc None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:23.059171 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36cf12-fd00-49a5-aad8-35982f159cbc None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:23.091595 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71988bb2-9cd1-4d6b-8d5d-77cb67910f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:23.092406 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988bb2-9cd1-4d6b-8d5d-77cb67910f62 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:23.092711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988bb2-9cd1-4d6b-8d5d-77cb67910f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:23.092986 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988bb2-9cd1-4d6b-8d5d-77cb67910f62 None admin] PATH_INFO: `/v3/users/37a9355cdff646a594ecf86fb5c65367` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:23.094104 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71988bb2-9cd1-4d6b-8d5d-77cb67910f62 None admin] RBAC: Authorizing `identity:get_user(user_id=37a9355cdff646a594ecf86fb5c65367)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:23.095527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71988bb2-9cd1-4d6b-8d5d-77cb67910f62 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:23.097116 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 559/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:22 2022] GET /identity/v3/users/37a9355cdff646a594ecf86fb5c65367 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:23.103475 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f2190-609f-4056-9b0e-6f43ab9f0073 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:23.162136 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:23.199886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f2190-609f-4056-9b0e-6f43ab9f0073 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:23.232663 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb866ed-80f6-4f45-955c-d1e33dc6475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:23.233254 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb866ed-80f6-4f45-955c-d1e33dc6475f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:23.233533 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb866ed-80f6-4f45-955c-d1e33dc6475f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:23.233805 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb866ed-80f6-4f45-955c-d1e33dc6475f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:23.298770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb866ed-80f6-4f45-955c-d1e33dc6475f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:23.300200 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb866ed-80f6-4f45-955c-d1e33dc6475f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:23.357582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:23.394772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 569/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:43:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:43:23.401191 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71988bb2-9cd1-4d6b-8d5d-77cb67910f62 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:23.445749 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:23.496541 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71988bb2-9cd1-4d6b-8d5d-77cb67910f62 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:23.528472 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08767cf-90aa-453a-aa2b-d970f55b3290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:23.529104 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08767cf-90aa-453a-aa2b-d970f55b3290 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:23.529376 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08767cf-90aa-453a-aa2b-d970f55b3290 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:23.529643 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08767cf-90aa-453a-aa2b-d970f55b3290 None admin] PATH_INFO: `/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:23.530732 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08767cf-90aa-453a-aa2b-d970f55b3290 None admin] RBAC: Authorizing `identity:get_project(project_id=8f6fe18ae32f40eaadc99cf82df7f69c)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:23.532135 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08767cf-90aa-453a-aa2b-d970f55b3290 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:23.533746 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 560/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:43:23 2022] GET /identity/v3/projects/8f6fe18ae32f40eaadc99cf82df7f69c => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:23.540297 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb866ed-80f6-4f45-955c-d1e33dc6475f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:23.635093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb866ed-80f6-4f45-955c-d1e33dc6475f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:23.667563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bf45e-a592-43e5-8351-a3aef0a7ed15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:23.668152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf45e-a592-43e5-8351-a3aef0a7ed15 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:23.668432 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf45e-a592-43e5-8351-a3aef0a7ed15 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:23.668732 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf45e-a592-43e5-8351-a3aef0a7ed15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:23.669447 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bf45e-a592-43e5-8351-a3aef0a7ed15 None admin] RBAC: Adding query filter params (role.id=3ebdb28c195f447294810f1033bb8e62, scope.project.id=8f6fe18ae32f40eaadc99cf82df7f69c, user.id=37a9355cdff646a594ecf86fb5c65367) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:23.669752 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bf45e-a592-43e5-8351-a3aef0a7ed15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:23.671160 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bf45e-a592-43e5-8351-a3aef0a7ed15 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:23.676655 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 570/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:43:23 2022] GET /identity/v3/role_assignments?user.id=37a9355cdff646a594ecf86fb5c65367&scope.project.id=8f6fe18ae32f40eaadc99cf82df7f69c&role.id=3ebdb28c195f447294810f1033bb8e62 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:25.791277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e0440-9237-4235-bd53-a00039ac088c None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:25.791789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e0440-9237-4235-bd53-a00039ac088c None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:25.791908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e0440-9237-4235-bd53-a00039ac088c None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:25.793178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 561/1131] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:25.798437 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f618a7a-27b5-4c3d-9a78-511cb22928ca None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:25.798865 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f618a7a-27b5-4c3d-9a78-511cb22928ca None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:25.798989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f618a7a-27b5-4c3d-9a78-511cb22928ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:25.818277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-9f618a7a-27b5-4c3d-9a78-511cb22928ca None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:25.819481 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-9f618a7a-27b5-4c3d-9a78-511cb22928ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:25.839158 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:25.884599 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 571/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:26.151859 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e0440-9237-4235-bd53-a00039ac088c None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:26.248088 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e0440-9237-4235-bd53-a00039ac088c None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:26.261301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:26.280870 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a582c-e691-45e6-94a2-00ceeb5ee2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:26.281481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a582c-e691-45e6-94a2-00ceeb5ee2ad None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:26.281755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a582c-e691-45e6-94a2-00ceeb5ee2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:26.282026 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a582c-e691-45e6-94a2-00ceeb5ee2ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:26.283103 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a582c-e691-45e6-94a2-00ceeb5ee2ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:26.284514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a582c-e691-45e6-94a2-00ceeb5ee2ad None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:26.286675 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 562/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:26.292408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f618a7a-27b5-4c3d-9a78-511cb22928ca None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:26.389831 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f618a7a-27b5-4c3d-9a78-511cb22928ca None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:26.423131 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81c04e-0e32-4266-b09d-71876d47c82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:26.423671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81c04e-0e32-4266-b09d-71876d47c82a None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:26.423949 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81c04e-0e32-4266-b09d-71876d47c82a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:26.424224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81c04e-0e32-4266-b09d-71876d47c82a None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:26.424916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81c04e-0e32-4266-b09d-71876d47c82a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:26.426378 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81c04e-0e32-4266-b09d-71876d47c82a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:26.454486 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 572/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Sep 25 00:43:26 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:43:28.589642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b2e4-6790-4be7-9db9-19fe48b1c2d1 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:28.590194 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b2e4-6790-4be7-9db9-19fe48b1c2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:28.590194 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b2e4-6790-4be7-9db9-19fe48b1c2d1 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:28.591535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 563/1135] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:28.596873 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61074c-45b4-4b44-adf1-d47a7e723b37 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:28.597267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61074c-45b4-4b44-adf1-d47a7e723b37 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:28.597420 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61074c-45b4-4b44-adf1-d47a7e723b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:28.615691 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-bd61074c-45b4-4b44-adf1-d47a7e723b37 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:28.616906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-bd61074c-45b4-4b44-adf1-d47a7e723b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:28.618821 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:28.682946 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 573/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:28.952168 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182b2e4-6790-4be7-9db9-19fe48b1c2d1 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:29.049259 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182b2e4-6790-4be7-9db9-19fe48b1c2d1 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:29.082421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7005bf-2702-4d5a-baee-b78361f8d0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:29.083035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7005bf-2702-4d5a-baee-b78361f8d0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:29.083312 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7005bf-2702-4d5a-baee-b78361f8d0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:29.083584 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7005bf-2702-4d5a-baee-b78361f8d0a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:29.084695 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7005bf-2702-4d5a-baee-b78361f8d0a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:29.086123 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7005bf-2702-4d5a-baee-b78361f8d0a7 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:29.087645 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 564/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:29.093369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61074c-45b4-4b44-adf1-d47a7e723b37 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:29.187749 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61074c-45b4-4b44-adf1-d47a7e723b37 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:29.219956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8df29-9c4c-43ba-be3d-1f95ee6f6550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:29.220491 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8df29-9c4c-43ba-be3d-1f95ee6f6550 None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:29.220794 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8df29-9c4c-43ba-be3d-1f95ee6f6550 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:29.221066 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8df29-9c4c-43ba-be3d-1f95ee6f6550 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:29.221708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8df29-9c4c-43ba-be3d-1f95ee6f6550 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:29.223691 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8df29-9c4c-43ba-be3d-1f95ee6f6550 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:29.233380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:29.245703 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 574/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:43:29 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:43:31.404439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43326c3d-32b1-4e24-8019-7bd96178ff4f None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:31.405032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43326c3d-32b1-4e24-8019-7bd96178ff4f None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:31.405124 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43326c3d-32b1-4e24-8019-7bd96178ff4f None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:31.406409 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 565/1139] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:31.411479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72210fc-82d4-46c4-9bde-37b1ead7a6d6 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:31.411891 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72210fc-82d4-46c4-9bde-37b1ead7a6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:31.412023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72210fc-82d4-46c4-9bde-37b1ead7a6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:31.429593 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-c72210fc-82d4-46c4-9bde-37b1ead7a6d6 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:31.430757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-c72210fc-82d4-46c4-9bde-37b1ead7a6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:31.494594 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 575/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:31.762963 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43326c3d-32b1-4e24-8019-7bd96178ff4f None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:31.811245 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:31.859919 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43326c3d-32b1-4e24-8019-7bd96178ff4f None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:31.892296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1b6af-8873-4884-8585-2084747bf633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:31.892933 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1b6af-8873-4884-8585-2084747bf633 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:31.893209 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1b6af-8873-4884-8585-2084747bf633 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:31.893477 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1b6af-8873-4884-8585-2084747bf633 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:31.903056 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1b6af-8873-4884-8585-2084747bf633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-60b1b6af-8873-4884-8585-2084747bf633 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:43:31.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:31.908862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:31.909869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:31.909869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:31.909869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:31.909869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:31.909869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:43:31.909869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:43:31.909869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:43:31.909869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:43:31.909869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:43:31.909869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:43:31.909869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:31.909869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:31.909869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 566/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:31.915346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72210fc-82d4-46c4-9bde-37b1ead7a6d6 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:32.014727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72210fc-82d4-46c4-9bde-37b1ead7a6d6 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:32.037240 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:32.048025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a6a32-9875-4442-ac07-98a6bb9ec873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:32.048659 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a6a32-9875-4442-ac07-98a6bb9ec873 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:32.048937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a6a32-9875-4442-ac07-98a6bb9ec873 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:32.049204 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a6a32-9875-4442-ac07-98a6bb9ec873 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:32.049859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a6a32-9875-4442-ac07-98a6bb9ec873 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:32.050157 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a6a32-9875-4442-ac07-98a6bb9ec873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:32.052152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a6a32-9875-4442-ac07-98a6bb9ec873 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:32.059811 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 576/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:43:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:32.066014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1b6af-8873-4884-8585-2084747bf633 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:32.160644 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1b6af-8873-4884-8585-2084747bf633 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:32.170699 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:32.195350 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de822c16-0e9f-4209-be9b-56c78b4ef19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:32.195968 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de822c16-0e9f-4209-be9b-56c78b4ef19f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:32.196247 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de822c16-0e9f-4209-be9b-56c78b4ef19f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:32.196519 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de822c16-0e9f-4209-be9b-56c78b4ef19f None admin] PATH_INFO: `/v3/users/1ff7c780c15947dca7515afd215c686f` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:32.209110 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de822c16-0e9f-4209-be9b-56c78b4ef19f None admin] RBAC: Authorizing `identity:get_user(user_id=1ff7c780c15947dca7515afd215c686f)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:32.210547 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de822c16-0e9f-4209-be9b-56c78b4ef19f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:32.212111 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 567/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:32 2022] GET /identity/v3/users/1ff7c780c15947dca7515afd215c686f => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:32.217991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a6a32-9875-4442-ac07-98a6bb9ec873 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:32.314924 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a6a32-9875-4442-ac07-98a6bb9ec873 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:32.347239 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe249e8e-5c48-4f09-ba87-d8fde3752efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:32.348377 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe249e8e-5c48-4f09-ba87-d8fde3752efb None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:32.348675 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe249e8e-5c48-4f09-ba87-d8fde3752efb None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:32.348946 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe249e8e-5c48-4f09-ba87-d8fde3752efb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:32.400951 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:32.414929 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe249e8e-5c48-4f09-ba87-d8fde3752efb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:32.416375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe249e8e-5c48-4f09-ba87-d8fde3752efb None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:32.509492 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 577/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:43:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:43:32.515464 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de822c16-0e9f-4209-be9b-56c78b4ef19f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:32.610702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de822c16-0e9f-4209-be9b-56c78b4ef19f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:32.642471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6595466-c7e3-4352-9de4-356ed0d0cc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:32.643080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6595466-c7e3-4352-9de4-356ed0d0cc80 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:32.643354 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6595466-c7e3-4352-9de4-356ed0d0cc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:32.643623 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6595466-c7e3-4352-9de4-356ed0d0cc80 None admin] PATH_INFO: `/v3/projects/ec31d099e95d434e8b50ab678df0ecf7` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:32.645288 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6595466-c7e3-4352-9de4-356ed0d0cc80 None admin] RBAC: Authorizing `identity:get_project(project_id=ec31d099e95d434e8b50ab678df0ecf7)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:32.646855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6595466-c7e3-4352-9de4-356ed0d0cc80 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:32.652194 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 568/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:43:32 2022] GET /identity/v3/projects/ec31d099e95d434e8b50ab678df0ecf7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:32.654968 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe249e8e-5c48-4f09-ba87-d8fde3752efb None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:32.734845 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:32.749770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe249e8e-5c48-4f09-ba87-d8fde3752efb None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:32.783206 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18907abc-1bde-4379-9ae0-e1a9ec68ba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:32.783802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907abc-1bde-4379-9ae0-e1a9ec68ba12 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:32.784079 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907abc-1bde-4379-9ae0-e1a9ec68ba12 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:32.784352 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907abc-1bde-4379-9ae0-e1a9ec68ba12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:32.785112 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18907abc-1bde-4379-9ae0-e1a9ec68ba12 None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=ec31d099e95d434e8b50ab678df0ecf7, user.id=1ff7c780c15947dca7515afd215c686f) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:32.785420 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18907abc-1bde-4379-9ae0-e1a9ec68ba12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:32.786841 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18907abc-1bde-4379-9ae0-e1a9ec68ba12 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:32.791964 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 578/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:43:32 2022] GET /identity/v3/role_assignments?user.id=1ff7c780c15947dca7515afd215c686f&scope.project.id=ec31d099e95d434e8b50ab678df0ecf7&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:34.900759 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd2809-7a74-47c5-bc32-d58482406a67 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:34.901286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd2809-7a74-47c5-bc32-d58482406a67 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:34.901286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd2809-7a74-47c5-bc32-d58482406a67 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:34.902631 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 569/1147] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:34.907745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653cc41-7c9e-4277-9653-7157947ede31 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:34.908156 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653cc41-7c9e-4277-9653-7157947ede31 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:34.908289 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653cc41-7c9e-4277-9653-7157947ede31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:34.927025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-f653cc41-7c9e-4277-9653-7157947ede31 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:34.928193 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-f653cc41-7c9e-4277-9653-7157947ede31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:34.991608 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 579/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:35.256416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd2809-7a74-47c5-bc32-d58482406a67 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:35.291955 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:35.355333 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd2809-7a74-47c5-bc32-d58482406a67 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:35.387222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b89c5-7565-42ff-ac61-dc60fbfc742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:35.387838 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b89c5-7565-42ff-ac61-dc60fbfc742b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:35.388117 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b89c5-7565-42ff-ac61-dc60fbfc742b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:35.388392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b89c5-7565-42ff-ac61-dc60fbfc742b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:35.398632 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b89c5-7565-42ff-ac61-dc60fbfc742b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-719b89c5-7565-42ff-ac61-dc60fbfc742b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:43:35.403392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:35.404540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:35.405548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:35.405548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:35.405548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:35.405548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:35.405548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:43:35.405548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:43:35.405548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:43:35.405548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:43:35.405548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:43:35.405548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:43:35.405548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:35.405548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:35.405548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 570/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:43:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:35.411043 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653cc41-7c9e-4277-9653-7157947ede31 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:35.487104 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:35.505602 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653cc41-7c9e-4277-9653-7157947ede31 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:35.538323 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f9ecb-3732-4a2b-b666-ac8b759cbed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:35.538861 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f9ecb-3732-4a2b-b666-ac8b759cbed6 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:35.539136 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f9ecb-3732-4a2b-b666-ac8b759cbed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:35.539403 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f9ecb-3732-4a2b-b666-ac8b759cbed6 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:35.540057 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f9ecb-3732-4a2b-b666-ac8b759cbed6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:35.540358 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f9ecb-3732-4a2b-b666-ac8b759cbed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:35.541730 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f9ecb-3732-4a2b-b666-ac8b759cbed6 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:35.549276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 580/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:43:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:35.554870 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b89c5-7565-42ff-ac61-dc60fbfc742b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:35.646867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:35.652858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b89c5-7565-42ff-ac61-dc60fbfc742b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:35.685119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623a80-b2aa-4b1b-aa82-9d677f2536d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:35.685765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623a80-b2aa-4b1b-aa82-9d677f2536d6 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:35.686042 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623a80-b2aa-4b1b-aa82-9d677f2536d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:35.686315 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623a80-b2aa-4b1b-aa82-9d677f2536d6 None admin] PATH_INFO: `/v3/users/1ff7c780c15947dca7515afd215c686f` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:35.687421 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98623a80-b2aa-4b1b-aa82-9d677f2536d6 None admin] RBAC: Authorizing `identity:get_user(user_id=1ff7c780c15947dca7515afd215c686f)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:35.688882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98623a80-b2aa-4b1b-aa82-9d677f2536d6 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:35.690435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 571/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:35 2022] GET /identity/v3/users/1ff7c780c15947dca7515afd215c686f => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:35.696975 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f9ecb-3732-4a2b-b666-ac8b759cbed6 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:35.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f9ecb-3732-4a2b-b666-ac8b759cbed6 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:35.825636 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34234596-72c6-43ac-be9f-afae27cfbe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:35.826262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34234596-72c6-43ac-be9f-afae27cfbe5e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:35.826544 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34234596-72c6-43ac-be9f-afae27cfbe5e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:35.826817 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34234596-72c6-43ac-be9f-afae27cfbe5e None admin] PATH_INFO: `/v3/projects/ec31d099e95d434e8b50ab678df0ecf7` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:35.827924 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34234596-72c6-43ac-be9f-afae27cfbe5e None admin] RBAC: Authorizing `identity:get_project(project_id=ec31d099e95d434e8b50ab678df0ecf7)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:35.829368 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34234596-72c6-43ac-be9f-afae27cfbe5e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:35.830968 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 581/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:43:35 2022] GET /identity/v3/projects/ec31d099e95d434e8b50ab678df0ecf7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:35.837513 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623a80-b2aa-4b1b-aa82-9d677f2536d6 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:35.944384 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623a80-b2aa-4b1b-aa82-9d677f2536d6 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:35.976895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fe48d-3486-47e2-9028-6d6b9f5279d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:35.977543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fe48d-3486-47e2-9028-6d6b9f5279d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:35.977819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fe48d-3486-47e2-9028-6d6b9f5279d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:35.978091 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fe48d-3486-47e2-9028-6d6b9f5279d5 None admin] PATH_INFO: `/v3/projects/ec31d099e95d434e8b50ab678df0ecf7/users/1ff7c780c15947dca7515afd215c686f/roles/a6d585feb70946b1b1ebcaece17d26b2` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:35.979950 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fe48d-3486-47e2-9028-6d6b9f5279d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec31d099e95d434e8b50ab678df0ecf7, user_id=1ff7c780c15947dca7515afd215c686f, role_id=a6d585feb70946b1b1ebcaece17d26b2)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:35.981411 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fe48d-3486-47e2-9028-6d6b9f5279d5 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:35.993815 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 572/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:43:35 2022] PUT /identity/v3/projects/ec31d099e95d434e8b50ab678df0ecf7/users/1ff7c780c15947dca7515afd215c686f/roles/a6d585feb70946b1b1ebcaece17d26b2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:43:38.087367 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134fb72-604c-49ef-a23e-68e8f4b183e9 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:38.087877 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134fb72-604c-49ef-a23e-68e8f4b183e9 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:38.087877 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134fb72-604c-49ef-a23e-68e8f4b183e9 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:38.089200 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 582/1154] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:38.094313 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ad096-e620-46f4-bfac-ef2205d9b175 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:38.094742 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ad096-e620-46f4-bfac-ef2205d9b175 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:38.094834 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ad096-e620-46f4-bfac-ef2205d9b175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:38.113534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-f01ad096-e620-46f4-bfac-ef2205d9b175 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:38.114701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-f01ad096-e620-46f4-bfac-ef2205d9b175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:38.131032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:38.178834 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 573/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:38.449447 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134fb72-604c-49ef-a23e-68e8f4b183e9 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:38.462071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:38.551375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134fb72-604c-49ef-a23e-68e8f4b183e9 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:38.583792 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a20a54-675c-4aa8-b244-f43142a571b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:38.584414 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a20a54-675c-4aa8-b244-f43142a571b1 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:38.584718 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a20a54-675c-4aa8-b244-f43142a571b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:38.584998 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a20a54-675c-4aa8-b244-f43142a571b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:38.595121 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a20a54-675c-4aa8-b244-f43142a571b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-89a20a54-675c-4aa8-b244-f43142a571b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:43:38.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:38.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:38.602171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:38.602171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:38.602171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:38.602171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:38.602171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:43:38.602171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:43:38.602171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:43:38.602171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:43:38.602171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:43:38.602171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:43:38.602171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:38.602171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:38.602171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 583/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:43:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:38.607879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ad096-e620-46f4-bfac-ef2205d9b175 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:38.702350 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ad096-e620-46f4-bfac-ef2205d9b175 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:38.734094 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88488b-8d2e-49f4-aa33-0ffbc088f02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:38.734681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88488b-8d2e-49f4-aa33-0ffbc088f02b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:38.734955 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88488b-8d2e-49f4-aa33-0ffbc088f02b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:38.735222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88488b-8d2e-49f4-aa33-0ffbc088f02b None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:38.735868 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88488b-8d2e-49f4-aa33-0ffbc088f02b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:38.736165 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88488b-8d2e-49f4-aa33-0ffbc088f02b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:38.738126 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88488b-8d2e-49f4-aa33-0ffbc088f02b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:38.745704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 574/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:43:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:38.751355 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a20a54-675c-4aa8-b244-f43142a571b1 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:38.818240 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:38.849232 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a20a54-675c-4aa8-b244-f43142a571b1 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:38.882055 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7052b-380d-4587-8d46-e3d8ccc055cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:38.882684 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7052b-380d-4587-8d46-e3d8ccc055cc None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:38.882964 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7052b-380d-4587-8d46-e3d8ccc055cc None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:38.883264 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7052b-380d-4587-8d46-e3d8ccc055cc None admin] PATH_INFO: `/v3/users/1ff7c780c15947dca7515afd215c686f` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:38.884403 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7052b-380d-4587-8d46-e3d8ccc055cc None admin] RBAC: Authorizing `identity:get_user(user_id=1ff7c780c15947dca7515afd215c686f)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:38.885870 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7052b-380d-4587-8d46-e3d8ccc055cc None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:38.887466 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 584/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:38 2022] GET /identity/v3/users/1ff7c780c15947dca7515afd215c686f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:38.893197 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88488b-8d2e-49f4-aa33-0ffbc088f02b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:38.911533 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:38.988957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88488b-8d2e-49f4-aa33-0ffbc088f02b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:39.021375 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b16f36-f517-4f95-8ccf-0ca7a0d09f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:39.021966 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b16f36-f517-4f95-8ccf-0ca7a0d09f0b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:39.022241 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b16f36-f517-4f95-8ccf-0ca7a0d09f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:39.022509 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b16f36-f517-4f95-8ccf-0ca7a0d09f0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:39.086381 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b16f36-f517-4f95-8ccf-0ca7a0d09f0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:39.087849 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b16f36-f517-4f95-8ccf-0ca7a0d09f0b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:39.103589 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:39.181078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 575/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:43:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:43:39.187083 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7052b-380d-4587-8d46-e3d8ccc055cc None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:39.282078 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7052b-380d-4587-8d46-e3d8ccc055cc None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:39.316171 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd8ce3-004d-4bf1-b876-b19d310d7258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:39.316810 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd8ce3-004d-4bf1-b876-b19d310d7258 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:39.317091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd8ce3-004d-4bf1-b876-b19d310d7258 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:39.317366 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd8ce3-004d-4bf1-b876-b19d310d7258 None admin] PATH_INFO: `/v3/projects/ec31d099e95d434e8b50ab678df0ecf7` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:39.318482 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd8ce3-004d-4bf1-b876-b19d310d7258 None admin] RBAC: Authorizing `identity:get_project(project_id=ec31d099e95d434e8b50ab678df0ecf7)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:39.319910 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd8ce3-004d-4bf1-b876-b19d310d7258 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:39.321537 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 585/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:43:39 2022] GET /identity/v3/projects/ec31d099e95d434e8b50ab678df0ecf7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:39.327647 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b16f36-f517-4f95-8ccf-0ca7a0d09f0b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:39.421588 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b16f36-f517-4f95-8ccf-0ca7a0d09f0b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:39.437624 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:39.455082 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85982b0e-51dc-4a31-bd15-2fb09f944e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:39.455669 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982b0e-51dc-4a31-bd15-2fb09f944e3d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:39.455969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982b0e-51dc-4a31-bd15-2fb09f944e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:39.456242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982b0e-51dc-4a31-bd15-2fb09f944e3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:39.456989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85982b0e-51dc-4a31-bd15-2fb09f944e3d None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=ec31d099e95d434e8b50ab678df0ecf7, user.id=1ff7c780c15947dca7515afd215c686f) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:39.457294 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85982b0e-51dc-4a31-bd15-2fb09f944e3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:39.458702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85982b0e-51dc-4a31-bd15-2fb09f944e3d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:39.464202 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 576/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:43:39 2022] GET /identity/v3/role_assignments?user.id=1ff7c780c15947dca7515afd215c686f&scope.project.id=ec31d099e95d434e8b50ab678df0ecf7&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:41.577301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71244758-5716-4c9f-b9c6-1074d3dcc6ad None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:41.577925 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71244758-5716-4c9f-b9c6-1074d3dcc6ad None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:41.577925 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71244758-5716-4c9f-b9c6-1074d3dcc6ad None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:41.579158 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 586/1162] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:41.584788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a654a-bf75-4c92-b3fc-ed402c37700d None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:41.585159 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a654a-bf75-4c92-b3fc-ed402c37700d None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:41.585333 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a654a-bf75-4c92-b3fc-ed402c37700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:41.603444 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-e61a654a-bf75-4c92-b3fc-ed402c37700d None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:41.604638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-e61a654a-bf75-4c92-b3fc-ed402c37700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:41.666698 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 577/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:41.928778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71244758-5716-4c9f-b9c6-1074d3dcc6ad None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:41.938305 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:42.028697 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71244758-5716-4c9f-b9c6-1074d3dcc6ad None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:42.060638 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91eaf07-ffa6-4a29-99de-8587ece9d4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:42.061240 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91eaf07-ffa6-4a29-99de-8587ece9d4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:42.061519 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91eaf07-ffa6-4a29-99de-8587ece9d4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:42.061794 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91eaf07-ffa6-4a29-99de-8587ece9d4f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:42.125832 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91eaf07-ffa6-4a29-99de-8587ece9d4f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:42.127260 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91eaf07-ffa6-4a29-99de-8587ece9d4f4 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:42.135039 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:42.221586 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 587/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:43:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:43:42.227481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a654a-bf75-4c92-b3fc-ed402c37700d None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:42.322112 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a654a-bf75-4c92-b3fc-ed402c37700d None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:42.333144 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:42.355557 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50c9de-83e8-4a27-9dbc-fd3ce3732a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:42.356180 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50c9de-83e8-4a27-9dbc-fd3ce3732a4a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:42.356456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50c9de-83e8-4a27-9dbc-fd3ce3732a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:42.356753 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50c9de-83e8-4a27-9dbc-fd3ce3732a4a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:42.363682 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50c9de-83e8-4a27-9dbc-fd3ce3732a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:42.365158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50c9de-83e8-4a27-9dbc-fd3ce3732a4a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-7a50c9de-83e8-4a27-9dbc-fd3ce3732a4a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:42.376147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:42.377391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:43:42.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 578/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Sep 25 00:43:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:42.383694 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91eaf07-ffa6-4a29-99de-8587ece9d4f4 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:42.482257 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91eaf07-ffa6-4a29-99de-8587ece9d4f4 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:42.490685 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:42.517425 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fc42d-a506-439b-aca2-0d46e0981286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:42.518024 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fc42d-a506-439b-aca2-0d46e0981286 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:42.518301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fc42d-a506-439b-aca2-0d46e0981286 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:42.518574 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fc42d-a506-439b-aca2-0d46e0981286 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:42.519206 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fc42d-a506-439b-aca2-0d46e0981286 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:42.519505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fc42d-a506-439b-aca2-0d46e0981286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:42.520880 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fc42d-a506-439b-aca2-0d46e0981286 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:42.527769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 588/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Sep 25 00:43:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:44.621349 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35af48-2f58-4104-bece-120378ea0897 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:44.621922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35af48-2f58-4104-bece-120378ea0897 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:44.622159 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35af48-2f58-4104-bece-120378ea0897 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:44.623491 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 579/1167] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:44.630796 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657441b-2795-4517-abd3-611552572259 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:44.631273 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657441b-2795-4517-abd3-611552572259 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:44.631402 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657441b-2795-4517-abd3-611552572259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:44.649707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-a657441b-2795-4517-abd3-611552572259 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:44.650888 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-a657441b-2795-4517-abd3-611552572259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:44.715264 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 589/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:44.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35af48-2f58-4104-bece-120378ea0897 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:45.083190 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35af48-2f58-4104-bece-120378ea0897 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:45.115586 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8b023-38f0-41c2-9a36-1e12aabddee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:45.116178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8b023-38f0-41c2-9a36-1e12aabddee1 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:45.116458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8b023-38f0-41c2-9a36-1e12aabddee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:45.116765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8b023-38f0-41c2-9a36-1e12aabddee1 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:45.117441 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8b023-38f0-41c2-9a36-1e12aabddee1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:45.118803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8b023-38f0-41c2-9a36-1e12aabddee1 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:45.134956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 580/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Sun Sep 25 00:43:44 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:43:47.254902 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28e669-2ca6-4fe0-aec3-2a50e0169491 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:47.255414 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28e669-2ca6-4fe0-aec3-2a50e0169491 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:47.255524 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28e669-2ca6-4fe0-aec3-2a50e0169491 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:47.256793 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 590/1170] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:47.262035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed76fc-d2fb-44c1-b9cf-e6dcd7893209 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:47.262404 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed76fc-d2fb-44c1-b9cf-e6dcd7893209 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:47.262592 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed76fc-d2fb-44c1-b9cf-e6dcd7893209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:47.280961 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-01ed76fc-d2fb-44c1-b9cf-e6dcd7893209 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:47.282154 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-01ed76fc-d2fb-44c1-b9cf-e6dcd7893209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:47.308176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:47.352034 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 581/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:47.618517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28e669-2ca6-4fe0-aec3-2a50e0169491 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:47.715493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:47.719555 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28e669-2ca6-4fe0-aec3-2a50e0169491 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:47.753086 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63b474-d3a4-4a4b-9110-5fb968a7fecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:47.753712 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63b474-d3a4-4a4b-9110-5fb968a7fecf None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:47.753990 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63b474-d3a4-4a4b-9110-5fb968a7fecf None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:47.754264 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63b474-d3a4-4a4b-9110-5fb968a7fecf None admin] PATH_INFO: `/v3/domains/cd8dfed8b7f44fbb90c01923bc7a1136` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:47.764149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63b474-d3a4-4a4b-9110-5fb968a7fecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=cd8dfed8b7f44fbb90c01923bc7a1136)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:47.765618 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63b474-d3a4-4a4b-9110-5fb968a7fecf None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:47.767207 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 591/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Sun Sep 25 00:43:47 2022] GET /identity/v3/domains/cd8dfed8b7f44fbb90c01923bc7a1136 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:47.773056 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed76fc-d2fb-44c1-b9cf-e6dcd7893209 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:47.869524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed76fc-d2fb-44c1-b9cf-e6dcd7893209 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:47.901341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b609fdf-a84d-43e8-97d0-84a47a893fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:47.901944 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b609fdf-a84d-43e8-97d0-84a47a893fdf None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:47.902223 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b609fdf-a84d-43e8-97d0-84a47a893fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:47.902499 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b609fdf-a84d-43e8-97d0-84a47a893fdf None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:47.903145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b609fdf-a84d-43e8-97d0-84a47a893fdf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:47.904592 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b609fdf-a84d-43e8-97d0-84a47a893fdf None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:47.931390 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 582/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Sep 25 00:43:47 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:43:50.106141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81252869-e7a9-4d85-8b15-a4d1978ae538 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:50.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81252869-e7a9-4d85-8b15-a4d1978ae538 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:50.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81252869-e7a9-4d85-8b15-a4d1978ae538 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:50.107938 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 592/1174] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:50.113156 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdbc89-05de-4c90-8d34-110945651c66 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:50.113554 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdbc89-05de-4c90-8d34-110945651c66 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:50.113712 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdbc89-05de-4c90-8d34-110945651c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:50.132098 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-e1bdbc89-05de-4c90-8d34-110945651c66 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:50.133328 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-e1bdbc89-05de-4c90-8d34-110945651c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:50.140378 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:50.198462 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 583/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:50.468898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81252869-e7a9-4d85-8b15-a4d1978ae538 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:50.569139 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81252869-e7a9-4d85-8b15-a4d1978ae538 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:50.600655 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3904890-0571-44cb-9504-2fc94da68fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:50.601270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904890-0571-44cb-9504-2fc94da68fad None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:50.601551 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904890-0571-44cb-9504-2fc94da68fad None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:50.601826 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904890-0571-44cb-9504-2fc94da68fad None admin] PATH_INFO: `/v3/domains/cd8dfed8b7f44fbb90c01923bc7a1136` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:50.602938 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3904890-0571-44cb-9504-2fc94da68fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=cd8dfed8b7f44fbb90c01923bc7a1136)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:50.604367 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3904890-0571-44cb-9504-2fc94da68fad None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:50.605935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 593/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Sun Sep 25 00:43:50 2022] GET /identity/v3/domains/cd8dfed8b7f44fbb90c01923bc7a1136 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:50.612211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdbc89-05de-4c90-8d34-110945651c66 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:50.711107 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdbc89-05de-4c90-8d34-110945651c66 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:50.744194 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30106aa-281a-44e9-bb34-0903af18e046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:50.744762 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30106aa-281a-44e9-bb34-0903af18e046 None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:50.745037 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30106aa-281a-44e9-bb34-0903af18e046 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:50.745305 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30106aa-281a-44e9-bb34-0903af18e046 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:50.745944 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30106aa-281a-44e9-bb34-0903af18e046 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:50.747349 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30106aa-281a-44e9-bb34-0903af18e046 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:50.762127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:50.768952 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 584/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:43:50 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:43:52.934393 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144623d-b3fb-48d5-8de1-85b38d4b6c26 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:52.934924 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144623d-b3fb-48d5-8de1-85b38d4b6c26 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:52.934924 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144623d-b3fb-48d5-8de1-85b38d4b6c26 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:52.936327 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 594/1178] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:52.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf9cda-dd73-43a0-a611-a6846b1d91cc None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:52.942358 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf9cda-dd73-43a0-a611-a6846b1d91cc None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:52.942524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf9cda-dd73-43a0-a611-a6846b1d91cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:52.960398 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-bfcf9cda-dd73-43a0-a611-a6846b1d91cc None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:52.961621 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-bfcf9cda-dd73-43a0-a611-a6846b1d91cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:53.024883 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 585/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:53.294783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144623d-b3fb-48d5-8de1-85b38d4b6c26 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:53.322689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:53.394592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144623d-b3fb-48d5-8de1-85b38d4b6c26 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:53.428715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe26181-6e5d-460d-857a-34803d3bdb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:53.429332 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26181-6e5d-460d-857a-34803d3bdb41 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:53.429613 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26181-6e5d-460d-857a-34803d3bdb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:53.429890 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26181-6e5d-460d-857a-34803d3bdb41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:53.440398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe26181-6e5d-460d-857a-34803d3bdb41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-efe26181-6e5d-460d-857a-34803d3bdb41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:43:53.445181 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:53.446346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:53.447467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:53.447467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:53.447467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:53.447467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:53.447467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:43:53.447467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:43:53.447467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:43:53.447467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:43:53.447467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:43:53.447467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:43:53.447467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:53.447467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:53.447467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 595/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:53.452225 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf9cda-dd73-43a0-a611-a6846b1d91cc None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:53.549061 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf9cda-dd73-43a0-a611-a6846b1d91cc None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:53.573920 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:53.581494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17876ba3-05a1-455e-a772-602fd818e3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:53.582092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17876ba3-05a1-455e-a772-602fd818e3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:53.582368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17876ba3-05a1-455e-a772-602fd818e3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:53.582639 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17876ba3-05a1-455e-a772-602fd818e3d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:53.583289 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17876ba3-05a1-455e-a772-602fd818e3d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:53.583588 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17876ba3-05a1-455e-a772-602fd818e3d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:53.584975 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17876ba3-05a1-455e-a772-602fd818e3d8 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:53.592635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 586/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:43:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:53.598553 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe26181-6e5d-460d-857a-34803d3bdb41 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:53.683126 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:53.695422 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe26181-6e5d-460d-857a-34803d3bdb41 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:53.727652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e57f6-d633-4060-abfc-f5c879f4e72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:53.728262 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e57f6-d633-4060-abfc-f5c879f4e72c None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:53.728539 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e57f6-d633-4060-abfc-f5c879f4e72c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:53.728831 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e57f6-d633-4060-abfc-f5c879f4e72c None admin] PATH_INFO: `/v3/users/67455bc8da564af3a0ab347afebd3c26` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:53.742782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e57f6-d633-4060-abfc-f5c879f4e72c None admin] RBAC: Authorizing `identity:get_user(user_id=67455bc8da564af3a0ab347afebd3c26)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:53.744206 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e57f6-d633-4060-abfc-f5c879f4e72c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:53.745783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 596/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:53 2022] GET /identity/v3/users/67455bc8da564af3a0ab347afebd3c26 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:53.751678 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17876ba3-05a1-455e-a772-602fd818e3d8 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:53.849452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17876ba3-05a1-455e-a772-602fd818e3d8 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:53.881325 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7dc97-cc8c-454f-a433-382f8db8814c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:53.881920 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7dc97-cc8c-454f-a433-382f8db8814c None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:53.882193 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7dc97-cc8c-454f-a433-382f8db8814c None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:53.882460 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7dc97-cc8c-454f-a433-382f8db8814c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:53.936121 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:53.946157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7dc97-cc8c-454f-a433-382f8db8814c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:53.947580 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7dc97-cc8c-454f-a433-382f8db8814c None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:54.039819 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 587/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:43:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:43:54.045788 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e57f6-d633-4060-abfc-f5c879f4e72c None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:54.139007 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e57f6-d633-4060-abfc-f5c879f4e72c None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:54.171476 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb400f-18e1-4575-bab2-6ad5414ac07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:54.172083 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb400f-18e1-4575-bab2-6ad5414ac07f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:54.172356 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb400f-18e1-4575-bab2-6ad5414ac07f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:54.172651 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb400f-18e1-4575-bab2-6ad5414ac07f None admin] PATH_INFO: `/v3/projects/6ff532e678054d75a2c25b130583af86` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:54.173788 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb400f-18e1-4575-bab2-6ad5414ac07f None admin] RBAC: Authorizing `identity:get_project(project_id=6ff532e678054d75a2c25b130583af86)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:54.175193 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb400f-18e1-4575-bab2-6ad5414ac07f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:54.176780 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 597/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:43:54 2022] GET /identity/v3/projects/6ff532e678054d75a2c25b130583af86 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:54.182726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7dc97-cc8c-454f-a433-382f8db8814c None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:54.267435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:54.277362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7dc97-cc8c-454f-a433-382f8db8814c None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:54.310441 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8403604-2587-473a-83a7-4adf07380ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:54.311035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8403604-2587-473a-83a7-4adf07380ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:54.311312 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8403604-2587-473a-83a7-4adf07380ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:54.311584 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8403604-2587-473a-83a7-4adf07380ff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:54.312297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8403604-2587-473a-83a7-4adf07380ff8 None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=6ff532e678054d75a2c25b130583af86, user.id=67455bc8da564af3a0ab347afebd3c26) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:54.312629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8403604-2587-473a-83a7-4adf07380ff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:54.314342 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8403604-2587-473a-83a7-4adf07380ff8 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:54.319441 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 588/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:43:54 2022] GET /identity/v3/role_assignments?user.id=67455bc8da564af3a0ab347afebd3c26&scope.project.id=6ff532e678054d75a2c25b130583af86&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:56.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f8788-d8ab-4447-9e77-f5498676be02 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:56.444597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f8788-d8ab-4447-9e77-f5498676be02 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:56.444597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f8788-d8ab-4447-9e77-f5498676be02 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:56.445913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 598/1186] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:56.450993 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2389e-4015-40cf-97d0-a393951b4b99 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:56.451371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2389e-4015-40cf-97d0-a393951b4b99 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:56.451547 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2389e-4015-40cf-97d0-a393951b4b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:56.470363 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-23d2389e-4015-40cf-97d0-a393951b4b99 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:56.471552 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-23d2389e-4015-40cf-97d0-a393951b4b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:56.538372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 589/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:43:56.803560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f8788-d8ab-4447-9e77-f5498676be02 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:56.819720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:56.903314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f8788-d8ab-4447-9e77-f5498676be02 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:56.935327 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca0175-ea98-4104-9368-072fa3318580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:56.935944 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca0175-ea98-4104-9368-072fa3318580 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:56.936260 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca0175-ea98-4104-9368-072fa3318580 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:56.936536 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca0175-ea98-4104-9368-072fa3318580 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:56.947044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca0175-ea98-4104-9368-072fa3318580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-43ca0175-ea98-4104-9368-072fa3318580 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:43:56.951773 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:56.952875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:56.954720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:56.954720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:56.954720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:56.954720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:56.954720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:43:56.954720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:43:56.954720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:43:56.954720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:43:56.954720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:43:56.954720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:43:56.954720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:56.954720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:43:56.954720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 599/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:43:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:56.959466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2389e-4015-40cf-97d0-a393951b4b99 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:57.038656 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:57.054565 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2389e-4015-40cf-97d0-a393951b4b99 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:57.086930 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18089d2f-bbe5-4508-a1af-b7bc3e0b9088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:57.087533 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18089d2f-bbe5-4508-a1af-b7bc3e0b9088 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:57.087814 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18089d2f-bbe5-4508-a1af-b7bc3e0b9088 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:57.088092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18089d2f-bbe5-4508-a1af-b7bc3e0b9088 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:57.088777 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18089d2f-bbe5-4508-a1af-b7bc3e0b9088 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:57.089084 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18089d2f-bbe5-4508-a1af-b7bc3e0b9088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:57.090441 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18089d2f-bbe5-4508-a1af-b7bc3e0b9088 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:57.098210 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 590/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:43:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:57.103830 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca0175-ea98-4104-9368-072fa3318580 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:57.175830 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:57.200619 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca0175-ea98-4104-9368-072fa3318580 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:57.232734 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14a5e8-8119-45d6-be0b-8af5c0c9cd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:57.233345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14a5e8-8119-45d6-be0b-8af5c0c9cd61 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:57.233623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14a5e8-8119-45d6-be0b-8af5c0c9cd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:57.233896 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14a5e8-8119-45d6-be0b-8af5c0c9cd61 None admin] PATH_INFO: `/v3/users/67455bc8da564af3a0ab347afebd3c26` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:57.235538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14a5e8-8119-45d6-be0b-8af5c0c9cd61 None admin] RBAC: Authorizing `identity:get_user(user_id=67455bc8da564af3a0ab347afebd3c26)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:57.236993 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14a5e8-8119-45d6-be0b-8af5c0c9cd61 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:57.238518 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 600/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:57 2022] GET /identity/v3/users/67455bc8da564af3a0ab347afebd3c26 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:57.244176 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18089d2f-bbe5-4508-a1af-b7bc3e0b9088 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:57.340362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18089d2f-bbe5-4508-a1af-b7bc3e0b9088 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:57.372671 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321ce22-927f-44c1-ad92-0e48e716b142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:57.373285 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321ce22-927f-44c1-ad92-0e48e716b142 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:57.373569 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321ce22-927f-44c1-ad92-0e48e716b142 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:57.373848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321ce22-927f-44c1-ad92-0e48e716b142 None admin] PATH_INFO: `/v3/projects/6ff532e678054d75a2c25b130583af86` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:57.374961 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321ce22-927f-44c1-ad92-0e48e716b142 None admin] RBAC: Authorizing `identity:get_project(project_id=6ff532e678054d75a2c25b130583af86)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:57.376955 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321ce22-927f-44c1-ad92-0e48e716b142 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:57.378539 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 591/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:43:57 2022] GET /identity/v3/projects/6ff532e678054d75a2c25b130583af86 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:57.384138 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14a5e8-8119-45d6-be0b-8af5c0c9cd61 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:57.479672 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14a5e8-8119-45d6-be0b-8af5c0c9cd61 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:57.512344 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f59ad-20f0-44eb-90ea-ae31f0078340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:57.513011 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f59ad-20f0-44eb-90ea-ae31f0078340 None admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:57.513292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f59ad-20f0-44eb-90ea-ae31f0078340 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:57.513567 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f59ad-20f0-44eb-90ea-ae31f0078340 None admin] PATH_INFO: `/v3/projects/6ff532e678054d75a2c25b130583af86/users/67455bc8da564af3a0ab347afebd3c26/roles/a6d585feb70946b1b1ebcaece17d26b2` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:57.515443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f59ad-20f0-44eb-90ea-ae31f0078340 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ff532e678054d75a2c25b130583af86, user_id=67455bc8da564af3a0ab347afebd3c26, role_id=a6d585feb70946b1b1ebcaece17d26b2)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:57.516923 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f59ad-20f0-44eb-90ea-ae31f0078340 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:57.529289 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 601/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:43:57 2022] PUT /identity/v3/projects/6ff532e678054d75a2c25b130583af86/users/67455bc8da564af3a0ab347afebd3c26/roles/a6d585feb70946b1b1ebcaece17d26b2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:43:59.645492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1c246-2a7a-4f53-85ec-4667445692a1 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:59.646053 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1c246-2a7a-4f53-85ec-4667445692a1 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:59.646053 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1c246-2a7a-4f53-85ec-4667445692a1 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:59.647377 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 592/1193] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:59.652721 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76df39-c3ba-4918-9de6-98768c422ccb None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:59.653100 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76df39-c3ba-4918-9de6-98768c422ccb None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:59.653279 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76df39-c3ba-4918-9de6-98768c422ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:59.660043 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:59.673805 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-ca76df39-c3ba-4918-9de6-98768c422ccb None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:59.674987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-ca76df39-c3ba-4918-9de6-98768c422ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:59.739739 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 602/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:44:00.005937 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1c246-2a7a-4f53-85ec-4667445692a1 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:00.023035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:00.106339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1c246-2a7a-4f53-85ec-4667445692a1 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:00.138366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57dfae-318e-48a4-83e3-3f1e7fd31068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:00.138987 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57dfae-318e-48a4-83e3-3f1e7fd31068 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:00.139269 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57dfae-318e-48a4-83e3-3f1e7fd31068 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:00.139542 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57dfae-318e-48a4-83e3-3f1e7fd31068 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:00.149701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57dfae-318e-48a4-83e3-3f1e7fd31068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-3c57dfae-318e-48a4-83e3-3f1e7fd31068 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:00.154439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:00.155530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:00.156410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:00.156410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:00.156410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:00.156410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:00.156410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:00.156410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:00.156410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:00.156410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:00.156410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:00.156410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:00.156410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:00.156410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:44:00.156410 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 593/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:44:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:00.162140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76df39-c3ba-4918-9de6-98768c422ccb None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:00.256606 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76df39-c3ba-4918-9de6-98768c422ccb None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:00.284992 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:00.290155 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03119d-265b-46af-8a50-d3587b416b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:00.290751 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03119d-265b-46af-8a50-d3587b416b96 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:00.291026 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03119d-265b-46af-8a50-d3587b416b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:00.291295 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03119d-265b-46af-8a50-d3587b416b96 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:00.291953 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03119d-265b-46af-8a50-d3587b416b96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:00.292250 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03119d-265b-46af-8a50-d3587b416b96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:00.293636 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03119d-265b-46af-8a50-d3587b416b96 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:00.301786 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 603/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:00.307550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57dfae-318e-48a4-83e3-3f1e7fd31068 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:00.380077 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:00.404321 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57dfae-318e-48a4-83e3-3f1e7fd31068 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:00.437066 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a878a5-2743-4e72-94c7-eaaf90c455c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:00.438457 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a878a5-2743-4e72-94c7-eaaf90c455c9 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:00.438736 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a878a5-2743-4e72-94c7-eaaf90c455c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:00.439009 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a878a5-2743-4e72-94c7-eaaf90c455c9 None admin] PATH_INFO: `/v3/users/67455bc8da564af3a0ab347afebd3c26` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:00.440117 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a878a5-2743-4e72-94c7-eaaf90c455c9 None admin] RBAC: Authorizing `identity:get_user(user_id=67455bc8da564af3a0ab347afebd3c26)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:00.441569 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a878a5-2743-4e72-94c7-eaaf90c455c9 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:00.443133 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 594/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:00 2022] GET /identity/v3/users/67455bc8da564af3a0ab347afebd3c26 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:00.448929 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03119d-265b-46af-8a50-d3587b416b96 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:00.546477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03119d-265b-46af-8a50-d3587b416b96 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:00.584025 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9fff1-0598-400e-9897-ff6d24e1626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:00.584648 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9fff1-0598-400e-9897-ff6d24e1626d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:00.584929 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9fff1-0598-400e-9897-ff6d24e1626d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:00.585203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9fff1-0598-400e-9897-ff6d24e1626d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:00.643197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:00.650762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9fff1-0598-400e-9897-ff6d24e1626d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:00.652202 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9fff1-0598-400e-9897-ff6d24e1626d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:00.745321 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 604/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:44:00.751778 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a878a5-2743-4e72-94c7-eaaf90c455c9 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:00.850183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a878a5-2743-4e72-94c7-eaaf90c455c9 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:00.883201 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81785961-8eb7-44a6-9c3b-c6573953388e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:00.883825 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81785961-8eb7-44a6-9c3b-c6573953388e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:00.884104 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81785961-8eb7-44a6-9c3b-c6573953388e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:00.884377 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81785961-8eb7-44a6-9c3b-c6573953388e None admin] PATH_INFO: `/v3/projects/6ff532e678054d75a2c25b130583af86` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:00.885504 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81785961-8eb7-44a6-9c3b-c6573953388e None admin] RBAC: Authorizing `identity:get_project(project_id=6ff532e678054d75a2c25b130583af86)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:00.886926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81785961-8eb7-44a6-9c3b-c6573953388e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:00.888538 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 595/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:00 2022] GET /identity/v3/projects/6ff532e678054d75a2c25b130583af86 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:00.894761 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9fff1-0598-400e-9897-ff6d24e1626d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:00.992156 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:00.998922 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9fff1-0598-400e-9897-ff6d24e1626d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:01.033971 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01977b37-535a-46c4-867b-2a7ebfbb0023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:01.034576 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01977b37-535a-46c4-867b-2a7ebfbb0023 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:01.034857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01977b37-535a-46c4-867b-2a7ebfbb0023 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:01.035132 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01977b37-535a-46c4-867b-2a7ebfbb0023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:01.035853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01977b37-535a-46c4-867b-2a7ebfbb0023 None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=6ff532e678054d75a2c25b130583af86, user.id=67455bc8da564af3a0ab347afebd3c26) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:01.036163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01977b37-535a-46c4-867b-2a7ebfbb0023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:01.037626 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01977b37-535a-46c4-867b-2a7ebfbb0023 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:01.043287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 605/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:00 2022] GET /identity/v3/role_assignments?user.id=67455bc8da564af3a0ab347afebd3c26&scope.project.id=6ff532e678054d75a2c25b130583af86&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:10.879154 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=95 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:11.041146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=21 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:56.265706 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f0963-93ad-4415-99d7-c8875cecb9c6 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:56.266284 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f0963-93ad-4415-99d7-c8875cecb9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:56.266576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f0963-93ad-4415-99d7-c8875cecb9c6 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:56.268117 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 596/1201] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:56.276850 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4e35a-e29b-4825-aab0-4622ed268354 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:56.277375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4e35a-e29b-4825-aab0-4622ed268354 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:56.277375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4e35a-e29b-4825-aab0-4622ed268354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:56.298898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-86f4e35a-e29b-4825-aab0-4622ed268354 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:56.300302 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-86f4e35a-e29b-4825-aab0-4622ed268354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:56.383848 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 606/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:44:56.658628 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f0963-93ad-4415-99d7-c8875cecb9c6 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:56.790013 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f0963-93ad-4415-99d7-c8875cecb9c6 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:56.850200 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc13b9-d5b0-4a47-b5b2-a5e12f42d60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:56.851461 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc13b9-d5b0-4a47-b5b2-a5e12f42d60a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:56.851783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc13b9-d5b0-4a47-b5b2-a5e12f42d60a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:56.852086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc13b9-d5b0-4a47-b5b2-a5e12f42d60a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:56.875154 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc13b9-d5b0-4a47-b5b2-a5e12f42d60a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:56.877096 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc13b9-d5b0-4a47-b5b2-a5e12f42d60a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-72cc13b9-d5b0-4a47-b5b2-a5e12f42d60a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:44:56.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:56.901174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:44:56.902501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:44:56.902501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:44:56.902501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:44:56.902501 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 597/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:56.908591 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4e35a-e29b-4825-aab0-4622ed268354 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:57.050259 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4e35a-e29b-4825-aab0-4622ed268354 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:57.098590 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:57.107893 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce76cd-a27f-4295-aa6c-d2baa86bd062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:57.108906 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce76cd-a27f-4295-aa6c-d2baa86bd062 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:57.109420 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce76cd-a27f-4295-aa6c-d2baa86bd062 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:57.109849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce76cd-a27f-4295-aa6c-d2baa86bd062 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:57.110899 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce76cd-a27f-4295-aa6c-d2baa86bd062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:57.111374 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce76cd-a27f-4295-aa6c-d2baa86bd062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:57.113097 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce76cd-a27f-4295-aa6c-d2baa86bd062 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:57.136750 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 607/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:57.141506 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc13b9-d5b0-4a47-b5b2-a5e12f42d60a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:57.224896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:57.296291 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc13b9-d5b0-4a47-b5b2-a5e12f42d60a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:57.335459 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a5e3d-b191-4e39-a5b4-306f96e5033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:57.336071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5e3d-b191-4e39-a5b4-306f96e5033d None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:57.336377 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5e3d-b191-4e39-a5b4-306f96e5033d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:57.336671 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5e3d-b191-4e39-a5b4-306f96e5033d None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:57.337387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a5e3d-b191-4e39-a5b4-306f96e5033d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:57.338826 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a5e3d-b191-4e39-a5b4-306f96e5033d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:57.373514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 598/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Sep 25 00:44:57 2022] POST /identity/v3/users => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:44:59.862626 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97f6bd-9e64-4a4b-a8de-ee3a23a2f9f1 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:59.863160 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97f6bd-9e64-4a4b-a8de-ee3a23a2f9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:59.863388 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97f6bd-9e64-4a4b-a8de-ee3a23a2f9f1 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:59.865009 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 608/1206] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:59.874990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d515ac-b0d2-4314-89da-ff2e1ff19da2 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:59.874990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d515ac-b0d2-4314-89da-ff2e1ff19da2 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:59.874990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d515ac-b0d2-4314-89da-ff2e1ff19da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:59.895113 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-e6d515ac-b0d2-4314-89da-ff2e1ff19da2 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:59.896375 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-e6d515ac-b0d2-4314-89da-ff2e1ff19da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:59.973272 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 599/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:00.260330 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97f6bd-9e64-4a4b-a8de-ee3a23a2f9f1 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:00.391452 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97f6bd-9e64-4a4b-a8de-ee3a23a2f9f1 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:00.432724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a8227-ac13-4dcc-81aa-4f6787840fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:00.433360 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8227-ac13-4dcc-81aa-4f6787840fbe None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:00.433638 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8227-ac13-4dcc-81aa-4f6787840fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:00.433971 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8227-ac13-4dcc-81aa-4f6787840fbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:00.447480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a8227-ac13-4dcc-81aa-4f6787840fbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-6c5a8227-ac13-4dcc-81aa-4f6787840fbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:00.453252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:00.454350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:00.455180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:00.455180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:00.455180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:00.455180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:00.455180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:00.455180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:00.455180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:00.455180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:00.455180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:00.455180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:00.455180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:00.455180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:00.455180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 609/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:00.461567 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d515ac-b0d2-4314-89da-ff2e1ff19da2 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:00.503584 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:00.588411 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d515ac-b0d2-4314-89da-ff2e1ff19da2 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:00.626728 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b636f0-b942-4265-8b82-33e3abb2c353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:00.627349 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b636f0-b942-4265-8b82-33e3abb2c353 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:00.627628 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b636f0-b942-4265-8b82-33e3abb2c353 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:00.627900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b636f0-b942-4265-8b82-33e3abb2c353 None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:00.628579 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b636f0-b942-4265-8b82-33e3abb2c353 None admin] RBAC: Adding query filter params (name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:00.628927 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b636f0-b942-4265-8b82-33e3abb2c353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:00.630273 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b636f0-b942-4265-8b82-33e3abb2c353 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:00.639204 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 600/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:00.645335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a8227-ac13-4dcc-81aa-4f6787840fbe None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:00.702302 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:00.764278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a8227-ac13-4dcc-81aa-4f6787840fbe None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:00.801434 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b54e50-267b-4d01-8d38-9b8f22d1349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:00.802068 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b54e50-267b-4d01-8d38-9b8f22d1349b None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:00.802346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b54e50-267b-4d01-8d38-9b8f22d1349b None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:00.802613 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b54e50-267b-4d01-8d38-9b8f22d1349b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:00.816917 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b54e50-267b-4d01-8d38-9b8f22d1349b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:00.818363 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b54e50-267b-4d01-8d38-9b8f22d1349b None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-a7b54e50-267b-4d01-8d38-9b8f22d1349b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:00.838064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:00.839183 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:00.840417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:00.840417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:00.840417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:00.840417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 610/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:00.847048 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b636f0-b942-4265-8b82-33e3abb2c353 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:00.956457 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:00.959836 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b636f0-b942-4265-8b82-33e3abb2c353 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:01.001595 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc7a00-c600-48b8-9b77-75b67a1961c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:01.002213 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc7a00-c600-48b8-9b77-75b67a1961c8 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:01.002505 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc7a00-c600-48b8-9b77-75b67a1961c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:01.002793 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc7a00-c600-48b8-9b77-75b67a1961c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:01.003439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc7a00-c600-48b8-9b77-75b67a1961c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:01.003880 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc7a00-c600-48b8-9b77-75b67a1961c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:01.005607 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc7a00-c600-48b8-9b77-75b67a1961c8 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:01.018701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 601/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:01.025486 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b54e50-267b-4d01-8d38-9b8f22d1349b None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:01.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b54e50-267b-4d01-8d38-9b8f22d1349b None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:01.138163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:01.178623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30ec03-b7c3-40e6-9a1f-7a446811121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:01.179887 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30ec03-b7c3-40e6-9a1f-7a446811121d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:01.180346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30ec03-b7c3-40e6-9a1f-7a446811121d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:01.180709 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30ec03-b7c3-40e6-9a1f-7a446811121d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:01.190254 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30ec03-b7c3-40e6-9a1f-7a446811121d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:01.191704 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30ec03-b7c3-40e6-9a1f-7a446811121d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-4a30ec03-b7c3-40e6-9a1f-7a446811121d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:01.204293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:01.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:01.206494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:01.206494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:01.206494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:01.206494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:01.206494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:01.206494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:01.206494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:01.206494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:01.206494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:45:01.206494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:01.206494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 611/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:01.213542 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc7a00-c600-48b8-9b77-75b67a1961c8 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:01.325625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc7a00-c600-48b8-9b77-75b67a1961c8 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:01.363119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd214f-4193-44ab-8918-3e7a5f01bf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:01.363736 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd214f-4193-44ab-8918-3e7a5f01bf68 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:01.364018 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd214f-4193-44ab-8918-3e7a5f01bf68 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:01.364296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd214f-4193-44ab-8918-3e7a5f01bf68 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:01.365057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd214f-4193-44ab-8918-3e7a5f01bf68 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:01.365360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd214f-4193-44ab-8918-3e7a5f01bf68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:01.367492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd214f-4193-44ab-8918-3e7a5f01bf68 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:01.388304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 602/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Sep 25 00:45:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:01.393842 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30ec03-b7c3-40e6-9a1f-7a446811121d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:01.509759 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30ec03-b7c3-40e6-9a1f-7a446811121d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:01.562111 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0efcf-3636-40c3-97fd-272909ae11eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:01.563298 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0efcf-3636-40c3-97fd-272909ae11eb None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:01.563824 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0efcf-3636-40c3-97fd-272909ae11eb None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:01.564640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0efcf-3636-40c3-97fd-272909ae11eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:01.600454 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:01.654076 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0efcf-3636-40c3-97fd-272909ae11eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:01.655475 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0efcf-3636-40c3-97fd-272909ae11eb None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:01.775445 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 612/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:45:01.781481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd214f-4193-44ab-8918-3e7a5f01bf68 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:01.803456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:01.897944 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd214f-4193-44ab-8918-3e7a5f01bf68 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:01.942277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961510-452e-406c-b94f-4a0ff1c5ae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:01.943048 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961510-452e-406c-b94f-4a0ff1c5ae74 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:01.943357 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961510-452e-406c-b94f-4a0ff1c5ae74 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:01.943665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961510-452e-406c-b94f-4a0ff1c5ae74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:01.954120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4961510-452e-406c-b94f-4a0ff1c5ae74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:01.955950 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4961510-452e-406c-b94f-4a0ff1c5ae74 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-f4961510-452e-406c-b94f-4a0ff1c5ae74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:01.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:01.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:01.978218 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:01.978218 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:01.978218 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:01.978218 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 603/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:01.984751 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0efcf-3636-40c3-97fd-272909ae11eb None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:02.050754 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:02.092264 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0efcf-3636-40c3-97fd-272909ae11eb None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:02.127719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e146b-d32b-45ce-9398-cce3e0e0c3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:02.128344 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e146b-d32b-45ce-9398-cce3e0e0c3bd None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:02.128718 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e146b-d32b-45ce-9398-cce3e0e0c3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:02.128992 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e146b-d32b-45ce-9398-cce3e0e0c3bd None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:02.129676 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e146b-d32b-45ce-9398-cce3e0e0c3bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:02.130049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e146b-d32b-45ce-9398-cce3e0e0c3bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:02.131421 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e146b-d32b-45ce-9398-cce3e0e0c3bd None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:02.143073 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 613/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:02.149387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961510-452e-406c-b94f-4a0ff1c5ae74 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:02.222996 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:02.260264 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961510-452e-406c-b94f-4a0ff1c5ae74 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:02.297157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19ffaf-a84d-40b5-85a9-ed4741957205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:02.297959 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19ffaf-a84d-40b5-85a9-ed4741957205 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:02.298275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19ffaf-a84d-40b5-85a9-ed4741957205 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:02.298614 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19ffaf-a84d-40b5-85a9-ed4741957205 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:02.305494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19ffaf-a84d-40b5-85a9-ed4741957205 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:02.307526 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19ffaf-a84d-40b5-85a9-ed4741957205 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-fd19ffaf-a84d-40b5-85a9-ed4741957205 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:02.320922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:02.322071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:02.323160 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:02.323160 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:02.323160 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:02.323160 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:02.323160 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:02.323160 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:02.323160 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:02.323160 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:02.323160 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 604/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:02.328109 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e146b-d32b-45ce-9398-cce3e0e0c3bd None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:02.432614 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e146b-d32b-45ce-9398-cce3e0e0c3bd None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:02.456149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:02.468762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c555eb-b62e-4511-9f76-c7d07385d3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:02.469374 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c555eb-b62e-4511-9f76-c7d07385d3fd None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:02.469655 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c555eb-b62e-4511-9f76-c7d07385d3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:02.469926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c555eb-b62e-4511-9f76-c7d07385d3fd None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:02.470629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c555eb-b62e-4511-9f76-c7d07385d3fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:02.470931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c555eb-b62e-4511-9f76-c7d07385d3fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:02.472366 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c555eb-b62e-4511-9f76-c7d07385d3fd None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:02.484812 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 614/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:02.491100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19ffaf-a84d-40b5-85a9-ed4741957205 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:02.605233 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19ffaf-a84d-40b5-85a9-ed4741957205 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:02.636646 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:02.643558 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23dda3-bab9-4244-96a3-c21766428771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:02.644166 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23dda3-bab9-4244-96a3-c21766428771 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:02.644445 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23dda3-bab9-4244-96a3-c21766428771 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:02.644756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23dda3-bab9-4244-96a3-c21766428771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:02.645481 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23dda3-bab9-4244-96a3-c21766428771 None admin] RBAC: Adding query filter params (role.id=e190761ca5494052a96426d0bd344261, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=bac1aba93232486eb2bd5b3200cb6fba) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:02.645786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23dda3-bab9-4244-96a3-c21766428771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:02.647209 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23dda3-bab9-4244-96a3-c21766428771 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:02.652543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 605/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:02 2022] GET /identity/v3/role_assignments?user.id=bac1aba93232486eb2bd5b3200cb6fba&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=e190761ca5494052a96426d0bd344261 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:04.946352 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2ec09-97ba-4c25-a0ef-a38e1f2cbb32 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:04.946937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2ec09-97ba-4c25-a0ef-a38e1f2cbb32 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:04.946937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2ec09-97ba-4c25-a0ef-a38e1f2cbb32 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:04.948271 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 615/1220] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:04.953619 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f96ee9-e995-4c3a-b06b-02292becd534 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:04.954092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f96ee9-e995-4c3a-b06b-02292becd534 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:04.954206 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f96ee9-e995-4c3a-b06b-02292becd534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:04.978503 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-c8f96ee9-e995-4c3a-b06b-02292becd534 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:04.978503 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-c8f96ee9-e995-4c3a-b06b-02292becd534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:05.055097 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 606/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:05.322863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2ec09-97ba-4c25-a0ef-a38e1f2cbb32 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:05.439824 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2ec09-97ba-4c25-a0ef-a38e1f2cbb32 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:05.474478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3697de1-e0d0-421b-a56e-aae3ebca8774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:05.475104 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3697de1-e0d0-421b-a56e-aae3ebca8774 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:05.475380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3697de1-e0d0-421b-a56e-aae3ebca8774 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:05.475677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3697de1-e0d0-421b-a56e-aae3ebca8774 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:05.485953 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3697de1-e0d0-421b-a56e-aae3ebca8774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-f3697de1-e0d0-421b-a56e-aae3ebca8774 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:05.490833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:05.492284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:05.493213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:05.493213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:05.493213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:05.493213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:05.493213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:05.493213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:05.493213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:05.493213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:05.493213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:05.493213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:05.493213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:05.493213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:05.493213 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 616/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:05.498094 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f96ee9-e995-4c3a-b06b-02292becd534 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:05.613128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f96ee9-e995-4c3a-b06b-02292becd534 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:05.638548 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:05.651497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0d19a-25b4-4fc0-a819-ead48b8e485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:05.652133 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0d19a-25b4-4fc0-a819-ead48b8e485e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:05.652416 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0d19a-25b4-4fc0-a819-ead48b8e485e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:05.652741 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0d19a-25b4-4fc0-a819-ead48b8e485e None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:05.653434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0d19a-25b4-4fc0-a819-ead48b8e485e None admin] RBAC: Adding query filter params (name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:05.653796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0d19a-25b4-4fc0-a819-ead48b8e485e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:05.655322 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0d19a-25b4-4fc0-a819-ead48b8e485e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:05.664133 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 607/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:05.669966 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3697de1-e0d0-421b-a56e-aae3ebca8774 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:05.719119 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:05.778802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3697de1-e0d0-421b-a56e-aae3ebca8774 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:05.818133 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca6d35-da10-469c-9614-93f8e6c21c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:05.818762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca6d35-da10-469c-9614-93f8e6c21c83 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:05.819036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca6d35-da10-469c-9614-93f8e6c21c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:05.819928 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca6d35-da10-469c-9614-93f8e6c21c83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:05.830720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca6d35-da10-469c-9614-93f8e6c21c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:05.832188 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca6d35-da10-469c-9614-93f8e6c21c83 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-f3ca6d35-da10-469c-9614-93f8e6c21c83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:05.848263 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:05.849499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:05.850614 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:05.850614 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:05.850614 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:05.850614 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 617/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:05.855229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0d19a-25b4-4fc0-a819-ead48b8e485e None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:05.962624 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0d19a-25b4-4fc0-a819-ead48b8e485e None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:05.996474 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f63c3d-0c24-40e1-9bd0-99188d456f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:05.997494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f63c3d-0c24-40e1-9bd0-99188d456f78 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:05.997990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f63c3d-0c24-40e1-9bd0-99188d456f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:05.998633 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f63c3d-0c24-40e1-9bd0-99188d456f78 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:05.999400 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f63c3d-0c24-40e1-9bd0-99188d456f78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:05.999703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f63c3d-0c24-40e1-9bd0-99188d456f78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:06.001163 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f63c3d-0c24-40e1-9bd0-99188d456f78 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:06.014735 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 608/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:06.020496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca6d35-da10-469c-9614-93f8e6c21c83 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:06.122362 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:06.129819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca6d35-da10-469c-9614-93f8e6c21c83 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:06.163560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8baae-7778-4f6c-bb3f-2bc30eb6ae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:06.164191 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8baae-7778-4f6c-bb3f-2bc30eb6ae6c None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:06.164463 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8baae-7778-4f6c-bb3f-2bc30eb6ae6c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:06.164759 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8baae-7778-4f6c-bb3f-2bc30eb6ae6c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:06.171940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8baae-7778-4f6c-bb3f-2bc30eb6ae6c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:06.173390 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8baae-7778-4f6c-bb3f-2bc30eb6ae6c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-2aa8baae-7778-4f6c-bb3f-2bc30eb6ae6c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:06.186128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:06.187690 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:06.188782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:06.188782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:06.188782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:06.188782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:06.188782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:06.188782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:06.188782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:06.188782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:06.188782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:45:06.188782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:06.188782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 618/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:06.193491 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f63c3d-0c24-40e1-9bd0-99188d456f78 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:06.244766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:06.311439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f63c3d-0c24-40e1-9bd0-99188d456f78 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:06.349553 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b2853-e803-4097-9360-7c80fd025b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:06.350174 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b2853-e803-4097-9360-7c80fd025b6e None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:06.351035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b2853-e803-4097-9360-7c80fd025b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:06.351354 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b2853-e803-4097-9360-7c80fd025b6e None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:06.352125 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b2853-e803-4097-9360-7c80fd025b6e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:06.352429 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b2853-e803-4097-9360-7c80fd025b6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:06.354002 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b2853-e803-4097-9360-7c80fd025b6e None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:06.372843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 609/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Sep 25 00:45:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:06.378985 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8baae-7778-4f6c-bb3f-2bc30eb6ae6c None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:06.487224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8baae-7778-4f6c-bb3f-2bc30eb6ae6c None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:06.526266 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2912b11-d685-46b7-8dc8-980b0f1fda9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:06.526833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2912b11-d685-46b7-8dc8-980b0f1fda9a None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:06.527082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2912b11-d685-46b7-8dc8-980b0f1fda9a None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:06.527354 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2912b11-d685-46b7-8dc8-980b0f1fda9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:06.540166 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2912b11-d685-46b7-8dc8-980b0f1fda9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:06.542164 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2912b11-d685-46b7-8dc8-980b0f1fda9a None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-e2912b11-d685-46b7-8dc8-980b0f1fda9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:06.558137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:06.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:06.560186 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:06.560186 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:06.560186 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:06.560186 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 619/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:06.565328 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b2853-e803-4097-9360-7c80fd025b6e None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:06.676130 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b2853-e803-4097-9360-7c80fd025b6e None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:06.678681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:06.713783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96813a65-8146-4ae8-aef7-bb9a95935a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:06.714399 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96813a65-8146-4ae8-aef7-bb9a95935a11 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:06.714679 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96813a65-8146-4ae8-aef7-bb9a95935a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:06.714952 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96813a65-8146-4ae8-aef7-bb9a95935a11 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:06.715592 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96813a65-8146-4ae8-aef7-bb9a95935a11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:06.715895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96813a65-8146-4ae8-aef7-bb9a95935a11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:06.717298 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96813a65-8146-4ae8-aef7-bb9a95935a11 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:06.730069 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 610/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:06.735934 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2912b11-d685-46b7-8dc8-980b0f1fda9a None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:06.745577 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:06.849379 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2912b11-d685-46b7-8dc8-980b0f1fda9a None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:06.888091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb283786-0a2b-4f6e-9aed-9dafa5db3d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:06.888837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283786-0a2b-4f6e-9aed-9dafa5db3d2d None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:06.889107 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283786-0a2b-4f6e-9aed-9dafa5db3d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:06.889393 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283786-0a2b-4f6e-9aed-9dafa5db3d2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:06.896759 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb283786-0a2b-4f6e-9aed-9dafa5db3d2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:06.898312 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb283786-0a2b-4f6e-9aed-9dafa5db3d2d None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-fb283786-0a2b-4f6e-9aed-9dafa5db3d2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:06.910268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:06.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:06.912623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:06.912623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:06.912623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:06.912623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:06.912623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:06.912623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:06.912623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:06.912623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:06.912623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 620/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:06.918536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96813a65-8146-4ae8-aef7-bb9a95935a11 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:07.028119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96813a65-8146-4ae8-aef7-bb9a95935a11 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:07.065858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bf59c-4fc9-48fe-9f8c-40e5cb9859b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:07.066468 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bf59c-4fc9-48fe-9f8c-40e5cb9859b0 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:07.066744 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bf59c-4fc9-48fe-9f8c-40e5cb9859b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:07.067014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bf59c-4fc9-48fe-9f8c-40e5cb9859b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:07.067703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bf59c-4fc9-48fe-9f8c-40e5cb9859b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:07.068007 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bf59c-4fc9-48fe-9f8c-40e5cb9859b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:07.069499 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bf59c-4fc9-48fe-9f8c-40e5cb9859b0 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:07.081653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 611/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:07.088163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb283786-0a2b-4f6e-9aed-9dafa5db3d2d None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:07.157961 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:07.196772 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb283786-0a2b-4f6e-9aed-9dafa5db3d2d None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:07.233670 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1110184-fd82-4abe-9bfb-ddb6e4e5e1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:07.234335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1110184-fd82-4abe-9bfb-ddb6e4e5e1e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:07.234616 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1110184-fd82-4abe-9bfb-ddb6e4e5e1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:07.234891 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1110184-fd82-4abe-9bfb-ddb6e4e5e1e6 None admin] PATH_INFO: `/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/bac1aba93232486eb2bd5b3200cb6fba/roles/e190761ca5494052a96426d0bd344261` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:07.251537 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1110184-fd82-4abe-9bfb-ddb6e4e5e1e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d5f67cc330446d1b77c741139f68e15, user_id=bac1aba93232486eb2bd5b3200cb6fba, role_id=e190761ca5494052a96426d0bd344261)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:07.253287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1110184-fd82-4abe-9bfb-ddb6e4e5e1e6 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:07.267572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 621/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:45:07 2022] PUT /identity/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/bac1aba93232486eb2bd5b3200cb6fba/roles/e190761ca5494052a96426d0bd344261 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:45:09.704006 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61642c-d717-4485-a358-89755550264a None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:09.704581 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61642c-d717-4485-a358-89755550264a None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:09.704581 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61642c-d717-4485-a358-89755550264a None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:09.706090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 612/1233] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:09.712682 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50b502-fba1-47c5-b3cd-f3b1aee3020b None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:09.713244 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50b502-fba1-47c5-b3cd-f3b1aee3020b None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:09.713244 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50b502-fba1-47c5-b3cd-f3b1aee3020b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:09.732089 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-2b50b502-fba1-47c5-b3cd-f3b1aee3020b None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:09.733334 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-2b50b502-fba1-47c5-b3cd-f3b1aee3020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:09.809634 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 622/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:10.090757 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61642c-d717-4485-a358-89755550264a None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.116587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:10.199186 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61642c-d717-4485-a358-89755550264a None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.236101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003aeec-7871-4d87-b755-60d1350e56af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.236789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003aeec-7871-4d87-b755-60d1350e56af None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.237073 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003aeec-7871-4d87-b755-60d1350e56af None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.237350 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003aeec-7871-4d87-b755-60d1350e56af None admin] PATH_INFO: `/v3/roles/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.248195 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003aeec-7871-4d87-b755-60d1350e56af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-8003aeec-7871-4d87-b755-60d1350e56af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:10.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:10.254524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:10.255662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:10.255662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:10.255662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:10.255662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:10.255662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:10.255662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:10.255662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:10.255662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:10.255662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:10.255662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:10.255662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:10.255662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:10.255662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 613/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:10.260712 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50b502-fba1-47c5-b3cd-f3b1aee3020b None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.308214 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:10.362972 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50b502-fba1-47c5-b3cd-f3b1aee3020b None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.400692 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44995c66-3703-45fa-ad09-b7920e3c6278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.401391 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44995c66-3703-45fa-ad09-b7920e3c6278 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.401741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44995c66-3703-45fa-ad09-b7920e3c6278 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.402017 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44995c66-3703-45fa-ad09-b7920e3c6278 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.402734 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44995c66-3703-45fa-ad09-b7920e3c6278 None admin] RBAC: Adding query filter params (name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:10.403077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44995c66-3703-45fa-ad09-b7920e3c6278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.404985 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44995c66-3703-45fa-ad09-b7920e3c6278 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.414782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 623/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:10.421077 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003aeec-7871-4d87-b755-60d1350e56af None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.528100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:10.547000 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003aeec-7871-4d87-b755-60d1350e56af None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.584091 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a01ef-5d4c-4c03-aefd-a44dcbb8301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.584906 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a01ef-5d4c-4c03-aefd-a44dcbb8301a None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.585182 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a01ef-5d4c-4c03-aefd-a44dcbb8301a None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.585454 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a01ef-5d4c-4c03-aefd-a44dcbb8301a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.596498 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a01ef-5d4c-4c03-aefd-a44dcbb8301a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.597990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a01ef-5d4c-4c03-aefd-a44dcbb8301a None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-224a01ef-5d4c-4c03-aefd-a44dcbb8301a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:10.612739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:10.613770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:10.614688 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:10.614688 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:10.614688 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:10.614688 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 614/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:10.621603 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44995c66-3703-45fa-ad09-b7920e3c6278 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.734585 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44995c66-3703-45fa-ad09-b7920e3c6278 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.745251 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:10.775423 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02202ee-3e9c-48aa-a3e0-16c022f11e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.776203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02202ee-3e9c-48aa-a3e0-16c022f11e92 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.776484 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02202ee-3e9c-48aa-a3e0-16c022f11e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.776789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02202ee-3e9c-48aa-a3e0-16c022f11e92 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.777429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02202ee-3e9c-48aa-a3e0-16c022f11e92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:10.777731 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02202ee-3e9c-48aa-a3e0-16c022f11e92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.779098 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02202ee-3e9c-48aa-a3e0-16c022f11e92 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.793266 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 624/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:10.799101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a01ef-5d4c-4c03-aefd-a44dcbb8301a None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.924199 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a01ef-5d4c-4c03-aefd-a44dcbb8301a None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.961755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b388fc-cd7b-40b2-822e-437eb901cd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.962387 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b388fc-cd7b-40b2-822e-437eb901cd95 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.962662 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b388fc-cd7b-40b2-822e-437eb901cd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.962976 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b388fc-cd7b-40b2-822e-437eb901cd95 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:10.971473 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b388fc-cd7b-40b2-822e-437eb901cd95 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.973095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b388fc-cd7b-40b2-822e-437eb901cd95 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-e8b388fc-cd7b-40b2-822e-437eb901cd95 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:10.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:10.986726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:10.988090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:10.988090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:10.988090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:10.988090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:10.988090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:10.988090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:10.988090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:10.988090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:10.988090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:45:10.988090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:10.988090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 615/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:10.992430 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02202ee-3e9c-48aa-a3e0-16c022f11e92 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:11.097026 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02202ee-3e9c-48aa-a3e0-16c022f11e92 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:11.130645 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcd054-e1ff-481b-ac12-28870a8668d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:11.131280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcd054-e1ff-481b-ac12-28870a8668d2 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:11.131555 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcd054-e1ff-481b-ac12-28870a8668d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:11.131824 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcd054-e1ff-481b-ac12-28870a8668d2 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:11.132545 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcd054-e1ff-481b-ac12-28870a8668d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:11.132875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcd054-e1ff-481b-ac12-28870a8668d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:11.134292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcd054-e1ff-481b-ac12-28870a8668d2 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:11.154031 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 625/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:11.159915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b388fc-cd7b-40b2-822e-437eb901cd95 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:11.268090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b388fc-cd7b-40b2-822e-437eb901cd95 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:11.303182 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147249d6-e0de-4918-b44a-abedcfb58f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:11.303788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147249d6-e0de-4918-b44a-abedcfb58f4c None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:11.304062 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147249d6-e0de-4918-b44a-abedcfb58f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:11.304333 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147249d6-e0de-4918-b44a-abedcfb58f4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:11.369309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:11.376815 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147249d6-e0de-4918-b44a-abedcfb58f4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:11.378449 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147249d6-e0de-4918-b44a-abedcfb58f4c None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:11.496006 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 616/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:45:11.501895 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcd054-e1ff-481b-ac12-28870a8668d2 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:11.533976 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:11.622312 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcd054-e1ff-481b-ac12-28870a8668d2 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:11.659107 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddb696-1c90-4bdd-baf2-f8af75b4c3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:11.659740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddb696-1c90-4bdd-baf2-f8af75b4c3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:11.660013 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddb696-1c90-4bdd-baf2-f8af75b4c3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:11.660283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddb696-1c90-4bdd-baf2-f8af75b4c3e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:11.671933 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddb696-1c90-4bdd-baf2-f8af75b4c3e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:11.673434 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddb696-1c90-4bdd-baf2-f8af75b4c3e0 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-27ddb696-1c90-4bdd-baf2-f8af75b4c3e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:11.689357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:11.690480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:11.691398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:11.691398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:11.691398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:11.691398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 626/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:11.698616 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147249d6-e0de-4918-b44a-abedcfb58f4c None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:11.805132 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:11.813051 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147249d6-e0de-4918-b44a-abedcfb58f4c None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:11.853671 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82522722-715b-4f26-bf22-eb4a17371a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:11.854294 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82522722-715b-4f26-bf22-eb4a17371a6f None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:11.854570 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82522722-715b-4f26-bf22-eb4a17371a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:11.854848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82522722-715b-4f26-bf22-eb4a17371a6f None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:11.855493 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82522722-715b-4f26-bf22-eb4a17371a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:11.855803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82522722-715b-4f26-bf22-eb4a17371a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:11.857345 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82522722-715b-4f26-bf22-eb4a17371a6f None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:11.869033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 617/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:11.875536 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddb696-1c90-4bdd-baf2-f8af75b4c3e0 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:11.964409 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:11.989710 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddb696-1c90-4bdd-baf2-f8af75b4c3e0 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:12.027615 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1f247-815c-4fc1-8552-4b7d9c325e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:12.028248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1f247-815c-4fc1-8552-4b7d9c325e70 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:12.028536 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1f247-815c-4fc1-8552-4b7d9c325e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:12.028841 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1f247-815c-4fc1-8552-4b7d9c325e70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:12.036075 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1f247-815c-4fc1-8552-4b7d9c325e70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:12.037590 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1f247-815c-4fc1-8552-4b7d9c325e70 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-e9a1f247-815c-4fc1-8552-4b7d9c325e70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:12.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:12.052021 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:12.053225 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:12.053225 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:12.053225 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:12.053225 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:12.053225 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:12.053225 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:12.053225 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:12.053225 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:12.053225 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 627/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:12.059136 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82522722-715b-4f26-bf22-eb4a17371a6f None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:12.173080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82522722-715b-4f26-bf22-eb4a17371a6f None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:12.213712 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ed065-ec2d-45df-aecc-e40a40dff351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:12.214316 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ed065-ec2d-45df-aecc-e40a40dff351 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:12.214595 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ed065-ec2d-45df-aecc-e40a40dff351 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:12.214864 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ed065-ec2d-45df-aecc-e40a40dff351 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:12.215559 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ed065-ec2d-45df-aecc-e40a40dff351 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:12.215860 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ed065-ec2d-45df-aecc-e40a40dff351 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:12.217310 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ed065-ec2d-45df-aecc-e40a40dff351 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:12.229810 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 618/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:12.236190 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1f247-815c-4fc1-8552-4b7d9c325e70 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:12.344912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1f247-815c-4fc1-8552-4b7d9c325e70 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:12.382382 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe77dfd-5b32-46be-9fe1-478b1bba471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:12.383071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe77dfd-5b32-46be-9fe1-478b1bba471c None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:12.383379 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe77dfd-5b32-46be-9fe1-478b1bba471c None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:12.383661 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe77dfd-5b32-46be-9fe1-478b1bba471c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:12.384392 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe77dfd-5b32-46be-9fe1-478b1bba471c None admin] RBAC: Adding query filter params (role.id=e190761ca5494052a96426d0bd344261, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=bac1aba93232486eb2bd5b3200cb6fba) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:12.384738 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe77dfd-5b32-46be-9fe1-478b1bba471c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:12.386168 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe77dfd-5b32-46be-9fe1-478b1bba471c None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:12.392440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 628/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:12 2022] GET /identity/v3/role_assignments?user.id=bac1aba93232486eb2bd5b3200cb6fba&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=e190761ca5494052a96426d0bd344261 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:14.693352 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134e6d7-e4e5-4860-86e2-3682867f6a84 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:14.693909 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134e6d7-e4e5-4860-86e2-3682867f6a84 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:14.693909 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134e6d7-e4e5-4860-86e2-3682867f6a84 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:14.695243 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 619/1247] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:14.700854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90754-29ac-4ef1-8a4b-ff0244ce9ba0 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:14.701369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90754-29ac-4ef1-8a4b-ff0244ce9ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:14.701471 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90754-29ac-4ef1-8a4b-ff0244ce9ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:14.708172 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:14.722883 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-8bc90754-29ac-4ef1-8a4b-ff0244ce9ba0 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:14.724141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-8bc90754-29ac-4ef1-8a4b-ff0244ce9ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:14.799071 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 629/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:15.088884 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134e6d7-e4e5-4860-86e2-3682867f6a84 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:15.106939 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:15.197821 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134e6d7-e4e5-4860-86e2-3682867f6a84 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:15.235820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9faf54-e82a-4ffb-a276-0e91fba13331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:15.236454 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9faf54-e82a-4ffb-a276-0e91fba13331 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:15.236760 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9faf54-e82a-4ffb-a276-0e91fba13331 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:15.237047 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9faf54-e82a-4ffb-a276-0e91fba13331 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:15.250095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9faf54-e82a-4ffb-a276-0e91fba13331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-5d9faf54-e82a-4ffb-a276-0e91fba13331 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:15.255301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:15.256995 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:15.258170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:15.258170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:15.258170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:15.258170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:15.258170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:15.258170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:15.258170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:15.258170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:15.258170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:15.258170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:15.258170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:15.258170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:15.258170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 620/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:15.263144 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc90754-29ac-4ef1-8a4b-ff0244ce9ba0 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:15.368722 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc90754-29ac-4ef1-8a4b-ff0244ce9ba0 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:15.400903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:15.407200 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd34a2-c794-4d9a-b598-283cc6bd0128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:15.407809 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd34a2-c794-4d9a-b598-283cc6bd0128 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:15.408095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd34a2-c794-4d9a-b598-283cc6bd0128 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:15.408365 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd34a2-c794-4d9a-b598-283cc6bd0128 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:15.409074 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd34a2-c794-4d9a-b598-283cc6bd0128 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:15.409372 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd34a2-c794-4d9a-b598-283cc6bd0128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:15.410739 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd34a2-c794-4d9a-b598-283cc6bd0128 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:15.419585 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 630/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:15.425470 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9faf54-e82a-4ffb-a276-0e91fba13331 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:15.509732 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:15.536519 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9faf54-e82a-4ffb-a276-0e91fba13331 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:15.578931 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bec52c-bdac-4a5d-93a9-30feb9cda17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:15.579583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bec52c-bdac-4a5d-93a9-30feb9cda17d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:15.579867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bec52c-bdac-4a5d-93a9-30feb9cda17d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:15.580164 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bec52c-bdac-4a5d-93a9-30feb9cda17d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:15.591105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bec52c-bdac-4a5d-93a9-30feb9cda17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:15.592604 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bec52c-bdac-4a5d-93a9-30feb9cda17d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-b5bec52c-bdac-4a5d-93a9-30feb9cda17d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:15.609341 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:15.610524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:15.611683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:15.611683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:15.611683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:15.611683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 621/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:15.618692 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd34a2-c794-4d9a-b598-283cc6bd0128 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:15.723724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd34a2-c794-4d9a-b598-283cc6bd0128 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:15.764391 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5670b-2e31-4ddc-bb0a-d82891f8aca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:15.765038 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5670b-2e31-4ddc-bb0a-d82891f8aca9 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:15.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5670b-2e31-4ddc-bb0a-d82891f8aca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:15.765590 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5670b-2e31-4ddc-bb0a-d82891f8aca9 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:15.766243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5670b-2e31-4ddc-bb0a-d82891f8aca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:15.766543 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5670b-2e31-4ddc-bb0a-d82891f8aca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:15.767918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5670b-2e31-4ddc-bb0a-d82891f8aca9 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:15.780424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 631/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:15.786267 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bec52c-bdac-4a5d-93a9-30feb9cda17d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:15.892214 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bec52c-bdac-4a5d-93a9-30feb9cda17d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:15.918152 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:15.926684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b336b-ef57-4df7-9c4c-6768cfa641af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:15.927932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b336b-ef57-4df7-9c4c-6768cfa641af None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:15.928212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b336b-ef57-4df7-9c4c-6768cfa641af None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:15.928484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b336b-ef57-4df7-9c4c-6768cfa641af None admin] PATH_INFO: `/v3/users/placement` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:15.937208 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b336b-ef57-4df7-9c4c-6768cfa641af None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:15.938688 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b336b-ef57-4df7-9c4c-6768cfa641af None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-144b336b-ef57-4df7-9c4c-6768cfa641af None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:15.949877 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:15.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:15.952216 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:15.952216 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:15.952216 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:15.952216 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:15.952216 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:15.952216 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:15.952216 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:15.952216 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:15.952216 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:45:15.952216 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:15.952216 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 622/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:15.956961 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5670b-2e31-4ddc-bb0a-d82891f8aca9 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:16.014118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:16.060516 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5670b-2e31-4ddc-bb0a-d82891f8aca9 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:16.095294 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beaf57-d2e1-43b6-9c5a-0633ff19983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:16.095928 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beaf57-d2e1-43b6-9c5a-0633ff19983f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:16.096205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beaf57-d2e1-43b6-9c5a-0633ff19983f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:16.096479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beaf57-d2e1-43b6-9c5a-0633ff19983f None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:16.097240 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89beaf57-d2e1-43b6-9c5a-0633ff19983f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:16.097546 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89beaf57-d2e1-43b6-9c5a-0633ff19983f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:16.098987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89beaf57-d2e1-43b6-9c5a-0633ff19983f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:16.117589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 632/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Sep 25 00:45:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:16.123575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b336b-ef57-4df7-9c4c-6768cfa641af None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:16.226407 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b336b-ef57-4df7-9c4c-6768cfa641af None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:16.257808 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb5e60-634c-45c6-be00-ca8c21db2b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:16.258406 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5e60-634c-45c6-be00-ca8c21db2b1d None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:16.258683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5e60-634c-45c6-be00-ca8c21db2b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:16.258953 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5e60-634c-45c6-be00-ca8c21db2b1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:16.311424 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:16.323772 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb5e60-634c-45c6-be00-ca8c21db2b1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:16.325242 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb5e60-634c-45c6-be00-ca8c21db2b1d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:16.418527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 623/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:45:16.424290 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beaf57-d2e1-43b6-9c5a-0633ff19983f None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:16.519935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beaf57-d2e1-43b6-9c5a-0633ff19983f None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:16.534760 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:16.561330 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df16d4d-88d9-4b93-b37c-549f6dedc8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:16.562091 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df16d4d-88d9-4b93-b37c-549f6dedc8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:16.562372 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df16d4d-88d9-4b93-b37c-549f6dedc8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:16.562798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df16d4d-88d9-4b93-b37c-549f6dedc8d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:16.574786 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df16d4d-88d9-4b93-b37c-549f6dedc8d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:16.576233 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df16d4d-88d9-4b93-b37c-549f6dedc8d9 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-9df16d4d-88d9-4b93-b37c-549f6dedc8d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:16.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:16.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:16.593245 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:16.593245 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:16.593245 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:16.593245 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 633/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:16.597748 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb5e60-634c-45c6-be00-ca8c21db2b1d None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:16.680902 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:16.692368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb5e60-634c-45c6-be00-ca8c21db2b1d None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:16.725087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a0e79-bc9b-4b3d-bc6f-cb6d44e23c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:16.725681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a0e79-bc9b-4b3d-bc6f-cb6d44e23c89 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:16.725960 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a0e79-bc9b-4b3d-bc6f-cb6d44e23c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:16.726232 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a0e79-bc9b-4b3d-bc6f-cb6d44e23c89 None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:16.726863 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a0e79-bc9b-4b3d-bc6f-cb6d44e23c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:16.727162 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a0e79-bc9b-4b3d-bc6f-cb6d44e23c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:16.728514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a0e79-bc9b-4b3d-bc6f-cb6d44e23c89 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:16.739157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 624/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:16.744517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df16d4d-88d9-4b93-b37c-549f6dedc8d9 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:16.842266 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df16d4d-88d9-4b93-b37c-549f6dedc8d9 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:16.874386 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce562f3-b2b9-49cc-8118-a56012fd50fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:16.875009 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce562f3-b2b9-49cc-8118-a56012fd50fa None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:16.875288 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce562f3-b2b9-49cc-8118-a56012fd50fa None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:16.875562 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce562f3-b2b9-49cc-8118-a56012fd50fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:16.882508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce562f3-b2b9-49cc-8118-a56012fd50fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:16.883946 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce562f3-b2b9-49cc-8118-a56012fd50fa None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-9ce562f3-b2b9-49cc-8118-a56012fd50fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:16.894853 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:16.895833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:16.897170 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:16.897170 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:16.897170 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:16.897170 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:16.897170 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:16.897170 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:16.897170 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:16.897170 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:16.897170 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 634/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:16.901834 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a0e79-bc9b-4b3d-bc6f-cb6d44e23c89 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:17.001472 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a0e79-bc9b-4b3d-bc6f-cb6d44e23c89 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:17.042797 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5780c0-18ac-41cc-af68-1b44cdb9ac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:17.043392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5780c0-18ac-41cc-af68-1b44cdb9ac35 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:17.043664 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5780c0-18ac-41cc-af68-1b44cdb9ac35 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:17.043931 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5780c0-18ac-41cc-af68-1b44cdb9ac35 None admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:17.044641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5780c0-18ac-41cc-af68-1b44cdb9ac35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:17.044943 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5780c0-18ac-41cc-af68-1b44cdb9ac35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:17.046362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5780c0-18ac-41cc-af68-1b44cdb9ac35 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:17.058741 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 625/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:17.064807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce562f3-b2b9-49cc-8118-a56012fd50fa None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:17.090815 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:17.162276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce562f3-b2b9-49cc-8118-a56012fd50fa None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:17.195477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff88cba-dc3e-492e-9104-d7e8ac786b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:17.196058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff88cba-dc3e-492e-9104-d7e8ac786b89 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:17.196335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff88cba-dc3e-492e-9104-d7e8ac786b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:17.196632 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff88cba-dc3e-492e-9104-d7e8ac786b89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:17.197348 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff88cba-dc3e-492e-9104-d7e8ac786b89 None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=bac1aba93232486eb2bd5b3200cb6fba) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:17.197651 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff88cba-dc3e-492e-9104-d7e8ac786b89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:17.199087 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff88cba-dc3e-492e-9104-d7e8ac786b89 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:17.204272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 635/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:17 2022] GET /identity/v3/role_assignments?user.id=bac1aba93232486eb2bd5b3200cb6fba&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:19.294218 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c44f64-d7a6-4fd0-88a7-0a2405e7e0bf None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:19.294744 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c44f64-d7a6-4fd0-88a7-0a2405e7e0bf None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:19.294744 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c44f64-d7a6-4fd0-88a7-0a2405e7e0bf None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:19.296092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 626/1261] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:19.301226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33916af9-5693-434b-9c9a-dee896e8216c None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:19.301645 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33916af9-5693-434b-9c9a-dee896e8216c None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:19.301781 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33916af9-5693-434b-9c9a-dee896e8216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:19.319569 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-33916af9-5693-434b-9c9a-dee896e8216c None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:19.320776 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-33916af9-5693-434b-9c9a-dee896e8216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:19.384079 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 636/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:19.662555 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c44f64-d7a6-4fd0-88a7-0a2405e7e0bf None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:19.673778 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:19.766908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c44f64-d7a6-4fd0-88a7-0a2405e7e0bf None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:19.799910 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb646dce-a9a5-4359-baf6-7d6b6d756d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:19.800524 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb646dce-a9a5-4359-baf6-7d6b6d756d32 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:19.800831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb646dce-a9a5-4359-baf6-7d6b6d756d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:19.801102 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb646dce-a9a5-4359-baf6-7d6b6d756d32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:19.811011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb646dce-a9a5-4359-baf6-7d6b6d756d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-bb646dce-a9a5-4359-baf6-7d6b6d756d32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:19.815790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:19.816885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:19.818412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:19.818412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:19.818412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:19.818412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:19.818412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:19.818412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:19.818412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:19.818412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:19.818412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:19.818412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:19.818412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:19.818412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:19.818412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 627/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:19.823492 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33916af9-5693-434b-9c9a-dee896e8216c None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:19.841915 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:19.919808 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33916af9-5693-434b-9c9a-dee896e8216c None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:19.952928 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42313e74-cd5f-4004-9aa7-e47c124facd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:19.953523 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313e74-cd5f-4004-9aa7-e47c124facd0 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:19.953800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313e74-cd5f-4004-9aa7-e47c124facd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:19.954075 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313e74-cd5f-4004-9aa7-e47c124facd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:19.954734 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42313e74-cd5f-4004-9aa7-e47c124facd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:19.955038 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42313e74-cd5f-4004-9aa7-e47c124facd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:19.956403 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42313e74-cd5f-4004-9aa7-e47c124facd0 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:19.964121 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 637/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:19.969740 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb646dce-a9a5-4359-baf6-7d6b6d756d32 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:20.033396 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:20.066611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb646dce-a9a5-4359-baf6-7d6b6d756d32 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:20.099869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7717bc6-2975-4060-899d-59e4ad9540da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:20.100502 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7717bc6-2975-4060-899d-59e4ad9540da None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:20.100803 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7717bc6-2975-4060-899d-59e4ad9540da None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:20.101076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7717bc6-2975-4060-899d-59e4ad9540da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:20.111287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7717bc6-2975-4060-899d-59e4ad9540da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:20.112939 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7717bc6-2975-4060-899d-59e4ad9540da None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-e7717bc6-2975-4060-899d-59e4ad9540da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:20.127080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:20.128177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:20.129308 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:20.129308 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:20.129308 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:20.129308 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 628/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:20.134589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42313e74-cd5f-4004-9aa7-e47c124facd0 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:20.212125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:20.230572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42313e74-cd5f-4004-9aa7-e47c124facd0 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:20.263373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915d557-bbb9-43c7-aa36-6c0a270ccfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:20.263971 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915d557-bbb9-43c7-aa36-6c0a270ccfe9 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:20.264249 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915d557-bbb9-43c7-aa36-6c0a270ccfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:20.264523 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915d557-bbb9-43c7-aa36-6c0a270ccfe9 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:20.265194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915d557-bbb9-43c7-aa36-6c0a270ccfe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:20.265497 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915d557-bbb9-43c7-aa36-6c0a270ccfe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:20.266884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915d557-bbb9-43c7-aa36-6c0a270ccfe9 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:20.278207 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 638/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:20.283715 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7717bc6-2975-4060-899d-59e4ad9540da None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:20.383649 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7717bc6-2975-4060-899d-59e4ad9540da None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:20.403014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:20.417077 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97464584-bcae-425c-9d12-84add3bd5c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:20.417698 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97464584-bcae-425c-9d12-84add3bd5c83 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:20.417976 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97464584-bcae-425c-9d12-84add3bd5c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:20.418248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97464584-bcae-425c-9d12-84add3bd5c83 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:20.425352 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97464584-bcae-425c-9d12-84add3bd5c83 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:20.427412 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97464584-bcae-425c-9d12-84add3bd5c83 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-97464584-bcae-425c-9d12-84add3bd5c83 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:20.438403 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:20.439492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:20.440442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:20.440442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:20.440442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:20.440442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:20.440442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:20.440442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:20.440442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:20.440442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:20.440442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:45:20.440442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:20.440442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 629/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:20.445346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915d557-bbb9-43c7-aa36-6c0a270ccfe9 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:20.544121 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915d557-bbb9-43c7-aa36-6c0a270ccfe9 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:20.577070 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca546-43ef-4e25-9b82-76557ed07cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:20.577666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca546-43ef-4e25-9b82-76557ed07cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:20.577940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca546-43ef-4e25-9b82-76557ed07cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:20.578208 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca546-43ef-4e25-9b82-76557ed07cf4 None admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:20.578930 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ca546-43ef-4e25-9b82-76557ed07cf4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:20.579234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ca546-43ef-4e25-9b82-76557ed07cf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:20.580666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ca546-43ef-4e25-9b82-76557ed07cf4 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:20.588830 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:20.596947 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 639/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Sep 25 00:45:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:20.603350 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97464584-bcae-425c-9d12-84add3bd5c83 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:20.699714 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97464584-bcae-425c-9d12-84add3bd5c83 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:20.732526 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798ee7-e38d-466e-9a49-9851fce3c137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:20.733164 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798ee7-e38d-466e-9a49-9851fce3c137 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:20.733442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798ee7-e38d-466e-9a49-9851fce3c137 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:20.733714 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798ee7-e38d-466e-9a49-9851fce3c137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:20.743805 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23798ee7-e38d-466e-9a49-9851fce3c137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:20.745267 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23798ee7-e38d-466e-9a49-9851fce3c137 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-23798ee7-e38d-466e-9a49-9851fce3c137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:20.758833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:20.759861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:20.760787 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:20.760787 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:20.760787 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:20.760787 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 630/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:20.765716 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca546-43ef-4e25-9b82-76557ed07cf4 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:20.863899 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca546-43ef-4e25-9b82-76557ed07cf4 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:20.896420 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4679728-f196-48a2-9eec-70e9803685f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:20.897056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4679728-f196-48a2-9eec-70e9803685f1 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:20.897336 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4679728-f196-48a2-9eec-70e9803685f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:20.897607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4679728-f196-48a2-9eec-70e9803685f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:20.898268 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4679728-f196-48a2-9eec-70e9803685f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:20.898567 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4679728-f196-48a2-9eec-70e9803685f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:20.899951 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4679728-f196-48a2-9eec-70e9803685f1 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:20.910676 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 640/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:20.916879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798ee7-e38d-466e-9a49-9851fce3c137 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:20.947208 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:21.013636 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798ee7-e38d-466e-9a49-9851fce3c137 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:21.045482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4546b94-913b-48d2-b766-7376bcd47c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:21.046096 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4546b94-913b-48d2-b766-7376bcd47c86 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:21.046375 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4546b94-913b-48d2-b766-7376bcd47c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:21.046648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4546b94-913b-48d2-b766-7376bcd47c86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:21.053001 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4546b94-913b-48d2-b766-7376bcd47c86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:21.054444 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4546b94-913b-48d2-b766-7376bcd47c86 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-e4546b94-913b-48d2-b766-7376bcd47c86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:21.066099 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:21.067629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:21.068538 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:21.068538 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:21.068538 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:21.068538 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:21.068538 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:21.068538 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:21.068538 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:21.068538 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:21.068538 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 631/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:21.073627 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4679728-f196-48a2-9eec-70e9803685f1 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:21.129172 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:21.170616 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4679728-f196-48a2-9eec-70e9803685f1 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:21.203143 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d61c9e-727b-46f7-8bae-91654948a893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:21.203738 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d61c9e-727b-46f7-8bae-91654948a893 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:21.204014 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d61c9e-727b-46f7-8bae-91654948a893 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:21.204284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d61c9e-727b-46f7-8bae-91654948a893 None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:21.204998 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d61c9e-727b-46f7-8bae-91654948a893 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:21.205303 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d61c9e-727b-46f7-8bae-91654948a893 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:21.206728 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d61c9e-727b-46f7-8bae-91654948a893 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:21.218695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 641/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:21.224500 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4546b94-913b-48d2-b766-7376bcd47c86 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:21.313160 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:21.322253 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4546b94-913b-48d2-b766-7376bcd47c86 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:21.354512 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef1156-cf00-4d2e-9ba5-eb514d16b66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:21.355154 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef1156-cf00-4d2e-9ba5-eb514d16b66d None admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:21.355428 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef1156-cf00-4d2e-9ba5-eb514d16b66d None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:21.355695 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef1156-cf00-4d2e-9ba5-eb514d16b66d None admin] PATH_INFO: `/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/bac1aba93232486eb2bd5b3200cb6fba/roles/a6d585feb70946b1b1ebcaece17d26b2` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:21.357576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef1156-cf00-4d2e-9ba5-eb514d16b66d None admin] RBAC: Authorizing `identity:create_grant(project_id=9d5f67cc330446d1b77c741139f68e15, user_id=bac1aba93232486eb2bd5b3200cb6fba, role_id=a6d585feb70946b1b1ebcaece17d26b2)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:21.359089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef1156-cf00-4d2e-9ba5-eb514d16b66d None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:21.371663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 632/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Sep 25 00:45:21 2022] PUT /identity/v3/projects/9d5f67cc330446d1b77c741139f68e15/users/bac1aba93232486eb2bd5b3200cb6fba/roles/a6d585feb70946b1b1ebcaece17d26b2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:45:23.488544 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd43215-aa1c-4ce4-a922-f158b8a0be1c None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:23.489698 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd43215-aa1c-4ce4-a922-f158b8a0be1c None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:23.489698 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd43215-aa1c-4ce4-a922-f158b8a0be1c None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:23.490998 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 642/1274] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:23.496332 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9d1d2-aaf2-4af2-a6cf-c6663d7d4ba4 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:23.496736 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9d1d2-aaf2-4af2-a6cf-c6663d7d4ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:23.496932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9d1d2-aaf2-4af2-a6cf-c6663d7d4ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:23.514730 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-cdb9d1d2-aaf2-4af2-a6cf-c6663d7d4ba4 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:23.515921 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-cdb9d1d2-aaf2-4af2-a6cf-c6663d7d4ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:23.588375 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 633/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:23.858940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd43215-aa1c-4ce4-a922-f158b8a0be1c None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:23.957924 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd43215-aa1c-4ce4-a922-f158b8a0be1c None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:23.974964 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:23.994958 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d9d45-8c38-4615-8b8e-f1e6a72cc411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:23.995704 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d9d45-8c38-4615-8b8e-f1e6a72cc411 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:23.995976 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d9d45-8c38-4615-8b8e-f1e6a72cc411 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:23.996254 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d9d45-8c38-4615-8b8e-f1e6a72cc411 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:24.006905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d9d45-8c38-4615-8b8e-f1e6a72cc411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-bf6d9d45-8c38-4615-8b8e-f1e6a72cc411 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:24.011711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:24.012926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:24.013871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:24.013871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:24.013871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:24.013871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:24.013871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:24.013871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:24.013871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:24.013871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:24.013871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:24.013871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:24.013871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:24.013871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:24.013871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 643/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:24.018996 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9d1d2-aaf2-4af2-a6cf-c6663d7d4ba4 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:24.097087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:24.115367 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9d1d2-aaf2-4af2-a6cf-c6663d7d4ba4 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:24.149445 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1588bb-2d72-43f3-ac76-be4c2e97b6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:24.150050 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1588bb-2d72-43f3-ac76-be4c2e97b6ab None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:24.150332 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1588bb-2d72-43f3-ac76-be4c2e97b6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:24.150605 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1588bb-2d72-43f3-ac76-be4c2e97b6ab None admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:24.151259 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1588bb-2d72-43f3-ac76-be4c2e97b6ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:24.151562 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1588bb-2d72-43f3-ac76-be4c2e97b6ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:24.152957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1588bb-2d72-43f3-ac76-be4c2e97b6ab None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:24.160660 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 634/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:24.166416 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d9d45-8c38-4615-8b8e-f1e6a72cc411 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:24.263828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d9d45-8c38-4615-8b8e-f1e6a72cc411 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:24.296240 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff15ea7-3f83-4dfd-b408-984f00e1e548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:24.297100 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff15ea7-3f83-4dfd-b408-984f00e1e548 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:24.297216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff15ea7-3f83-4dfd-b408-984f00e1e548 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:24.297421 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff15ea7-3f83-4dfd-b408-984f00e1e548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:24.309958 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff15ea7-3f83-4dfd-b408-984f00e1e548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:24.311405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff15ea7-3f83-4dfd-b408-984f00e1e548 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-cff15ea7-3f83-4dfd-b408-984f00e1e548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:24.326857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:24.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:24.329340 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:24.329340 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:24.329340 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:24.329340 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 644/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:24.333722 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1588bb-2d72-43f3-ac76-be4c2e97b6ab None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:24.428366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1588bb-2d72-43f3-ac76-be4c2e97b6ab None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:24.460090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac53178-efea-42bd-8d03-700c7fdcb2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:24.460702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac53178-efea-42bd-8d03-700c7fdcb2cb None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:24.460980 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac53178-efea-42bd-8d03-700c7fdcb2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:24.461248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac53178-efea-42bd-8d03-700c7fdcb2cb None admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:24.461874 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac53178-efea-42bd-8d03-700c7fdcb2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:24.462170 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac53178-efea-42bd-8d03-700c7fdcb2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:24.463511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac53178-efea-42bd-8d03-700c7fdcb2cb None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:24.475057 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 635/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:24.480572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff15ea7-3f83-4dfd-b408-984f00e1e548 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:24.510114 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:24.579951 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff15ea7-3f83-4dfd-b408-984f00e1e548 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:24.613002 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50bf91-0002-452a-9fff-e367ff69befe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:24.613648 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50bf91-0002-452a-9fff-e367ff69befe None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:24.613928 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50bf91-0002-452a-9fff-e367ff69befe None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:24.614202 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50bf91-0002-452a-9fff-e367ff69befe None admin] PATH_INFO: `/v3/users/placement` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:24.621380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50bf91-0002-452a-9fff-e367ff69befe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:24.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50bf91-0002-452a-9fff-e367ff69befe None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-da50bf91-0002-452a-9fff-e367ff69befe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:24.636936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:24.638162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:24.639122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:24.639122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:24.639122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:24.639122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:24.639122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:24.639122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:24.639122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:24.639122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:24.639122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:45:24.639122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:24.639122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 645/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:24.643989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac53178-efea-42bd-8d03-700c7fdcb2cb None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:24.648259 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:24.739775 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac53178-efea-42bd-8d03-700c7fdcb2cb None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:24.772032 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0367e-cafe-4ef2-af28-54b0b0251171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:24.772646 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0367e-cafe-4ef2-af28-54b0b0251171 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:24.772926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0367e-cafe-4ef2-af28-54b0b0251171 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:24.773196 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0367e-cafe-4ef2-af28-54b0b0251171 None admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:24.773904 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0367e-cafe-4ef2-af28-54b0b0251171 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:24.774203 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0367e-cafe-4ef2-af28-54b0b0251171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:24.775608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0367e-cafe-4ef2-af28-54b0b0251171 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:24.792301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 636/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Sep 25 00:45:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:24.797988 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50bf91-0002-452a-9fff-e367ff69befe None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:24.885685 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:24.896320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50bf91-0002-452a-9fff-e367ff69befe None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:24.928142 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d9044-f8c9-48f4-bf6e-dd8c7d93eae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:24.928763 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d9044-f8c9-48f4-bf6e-dd8c7d93eae8 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:24.929040 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d9044-f8c9-48f4-bf6e-dd8c7d93eae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:24.929572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d9044-f8c9-48f4-bf6e-dd8c7d93eae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:24.997235 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d9044-f8c9-48f4-bf6e-dd8c7d93eae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:24.998599 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d9044-f8c9-48f4-bf6e-dd8c7d93eae8 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:25.082782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:25.092869 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 646/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:45:25.098663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0367e-cafe-4ef2-af28-54b0b0251171 None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:25.156282 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:25.193654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0367e-cafe-4ef2-af28-54b0b0251171 None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:25.225753 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc840785-4012-46ce-b493-8767718ddb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:25.226362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc840785-4012-46ce-b493-8767718ddb9b None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.226633 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc840785-4012-46ce-b493-8767718ddb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.226900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc840785-4012-46ce-b493-8767718ddb9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc840785-4012-46ce-b493-8767718ddb9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:25.237788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc840785-4012-46ce-b493-8767718ddb9b None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-fc840785-4012-46ce-b493-8767718ddb9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:25.252095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:25.253215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:25.254713 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:25.254713 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:25.254713 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:25.254713 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 637/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:25.259243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d9044-f8c9-48f4-bf6e-dd8c7d93eae8 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:25.352517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d9044-f8c9-48f4-bf6e-dd8c7d93eae8 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:25.385368 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c93fa-395b-4354-b9d6-f55cb81edf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:25.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c93fa-395b-4354-b9d6-f55cb81edf3e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.386228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c93fa-395b-4354-b9d6-f55cb81edf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.386497 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c93fa-395b-4354-b9d6-f55cb81edf3e None admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.387126 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c93fa-395b-4354-b9d6-f55cb81edf3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:25.387424 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c93fa-395b-4354-b9d6-f55cb81edf3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:25.388789 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c93fa-395b-4354-b9d6-f55cb81edf3e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:25.399379 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 647/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:25.404717 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc840785-4012-46ce-b493-8767718ddb9b None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:25.500147 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc840785-4012-46ce-b493-8767718ddb9b None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:25.513679 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:25.533810 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e01f95-3637-46af-bb7d-cba3ae2f40ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:25.534423 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e01f95-3637-46af-bb7d-cba3ae2f40ac None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.534699 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e01f95-3637-46af-bb7d-cba3ae2f40ac None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.534969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e01f95-3637-46af-bb7d-cba3ae2f40ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.541786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e01f95-3637-46af-bb7d-cba3ae2f40ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:25.543204 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e01f95-3637-46af-bb7d-cba3ae2f40ac None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application [None req-d5e01f95-3637-46af-bb7d-cba3ae2f40ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:25.554878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:25.555935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:25.556891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:25.556891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:25.556891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:25.556891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:25.556891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:25.556891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:25.556891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:25.556891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: ERROR keystone.server.flask.application Sep 25 00:45:25.556891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 638/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:25.561665 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c93fa-395b-4354-b9d6-f55cb81edf3e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:25.609174 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:25.657123 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c93fa-395b-4354-b9d6-f55cb81edf3e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:25.689790 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91406d9d-e3f4-4017-bd51-2ec6dc560a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:25.690376 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91406d9d-e3f4-4017-bd51-2ec6dc560a04 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.690652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91406d9d-e3f4-4017-bd51-2ec6dc560a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.690919 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91406d9d-e3f4-4017-bd51-2ec6dc560a04 None admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.691618 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91406d9d-e3f4-4017-bd51-2ec6dc560a04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:25.691920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91406d9d-e3f4-4017-bd51-2ec6dc560a04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:25.693362 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91406d9d-e3f4-4017-bd51-2ec6dc560a04 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:25.704693 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 648/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:25.710642 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e01f95-3637-46af-bb7d-cba3ae2f40ac None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:25.807581 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e01f95-3637-46af-bb7d-cba3ae2f40ac None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:25.839521 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f6dbe-87da-4861-b641-3e36913349ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:25.840117 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f6dbe-87da-4861-b641-3e36913349ce None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.840389 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f6dbe-87da-4861-b641-3e36913349ce None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.840683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f6dbe-87da-4861-b641-3e36913349ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.841395 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f6dbe-87da-4861-b641-3e36913349ce None admin] RBAC: Adding query filter params (role.id=a6d585feb70946b1b1ebcaece17d26b2, scope.project.id=9d5f67cc330446d1b77c741139f68e15, user.id=bac1aba93232486eb2bd5b3200cb6fba) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:25.841696 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f6dbe-87da-4861-b641-3e36913349ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:25.843104 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f6dbe-87da-4861-b641-3e36913349ce None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:25.849140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 639/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:25 2022] GET /identity/v3/role_assignments?user.id=bac1aba93232486eb2bd5b3200cb6fba&scope.project.id=9d5f67cc330446d1b77c741139f68e15&role.id=a6d585feb70946b1b1ebcaece17d26b2 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:27.984478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c1fc-8a0d-4157-aba1-04513a653fed None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:27.985076 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c1fc-8a0d-4157-aba1-04513a653fed None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:27.985076 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c1fc-8a0d-4157-aba1-04513a653fed None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:27.986380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 649/1288] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:27.991601 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1857e-cd8c-494f-9867-324b946f00de None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:27.991968 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1857e-cd8c-494f-9867-324b946f00de None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:27.992155 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1857e-cd8c-494f-9867-324b946f00de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:28.010479 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-2ce1857e-cd8c-494f-9867-324b946f00de None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:28.011648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-2ce1857e-cd8c-494f-9867-324b946f00de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:28.040158 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:28.076630 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 640/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:28.346082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426c1fc-8a0d-4157-aba1-04513a653fed None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:28.444779 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426c1fc-8a0d-4157-aba1-04513a653fed None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:28.454908 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:28.477979 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1dd48-0002-442f-9ba5-40b1f5a5cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:28.478592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1dd48-0002-442f-9ba5-40b1f5a5cb39 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:28.478867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1dd48-0002-442f-9ba5-40b1f5a5cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:28.479135 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1dd48-0002-442f-9ba5-40b1f5a5cb39 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:28.479708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1dd48-0002-442f-9ba5-40b1f5a5cb39 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:28.481093 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1dd48-0002-442f-9ba5-40b1f5a5cb39 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-b4a1dd48-0002-442f-9ba5-40b1f5a5cb39 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:28.490113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:28.491375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:28.492427 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 650/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Sep 25 00:45:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:28.497046 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1857e-cd8c-494f-9867-324b946f00de None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:28.603184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1857e-cd8c-494f-9867-324b946f00de None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:28.636658 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bd6c6-8ff2-4534-be3a-bc1bbb1099e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:28.637236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bd6c6-8ff2-4534-be3a-bc1bbb1099e9 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:28.637508 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bd6c6-8ff2-4534-be3a-bc1bbb1099e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:28.637777 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bd6c6-8ff2-4534-be3a-bc1bbb1099e9 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:28.638394 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bd6c6-8ff2-4534-be3a-bc1bbb1099e9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:28.638711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bd6c6-8ff2-4534-be3a-bc1bbb1099e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:28.640109 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bd6c6-8ff2-4534-be3a-bc1bbb1099e9 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:28.644747 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 641/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Sep 25 00:45:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:28.650465 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1dd48-0002-442f-9ba5-40b1f5a5cb39 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:28.758375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1dd48-0002-442f-9ba5-40b1f5a5cb39 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:28.790216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ea641-df0a-4e41-b6fa-947dd1e2b71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:28.790807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ea641-df0a-4e41-b6fa-947dd1e2b71f None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:28.791083 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ea641-df0a-4e41-b6fa-947dd1e2b71f None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:28.791357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ea641-df0a-4e41-b6fa-947dd1e2b71f None admin] PATH_INFO: `/v3/services` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:28.791980 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ea641-df0a-4e41-b6fa-947dd1e2b71f None admin] RBAC: Adding query filter params (type=placement) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:28.792282 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ea641-df0a-4e41-b6fa-947dd1e2b71f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:28.793675 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ea641-df0a-4e41-b6fa-947dd1e2b71f None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:28.797900 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 651/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Sep 25 00:45:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:30.895990 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15148c97-3a32-4ed7-a0d5-26b168328204 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:30.896448 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15148c97-3a32-4ed7-a0d5-26b168328204 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:30.896536 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15148c97-3a32-4ed7-a0d5-26b168328204 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:30.897889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 642/1293] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:30.902953 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3b92-76c5-48af-a78a-d6dcf11beadc None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:30.903336 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3b92-76c5-48af-a78a-d6dcf11beadc None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:30.903508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3b92-76c5-48af-a78a-d6dcf11beadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:30.921314 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-241c3b92-76c5-48af-a78a-d6dcf11beadc None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:30.922511 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-241c3b92-76c5-48af-a78a-d6dcf11beadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:30.951558 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:30.988024 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 652/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:31.261307 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15148c97-3a32-4ed7-a0d5-26b168328204 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:31.291035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:31.358100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15148c97-3a32-4ed7-a0d5-26b168328204 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:31.390689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037d0f9-4e96-4d93-89aa-88eb2e9be69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:31.391279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037d0f9-4e96-4d93-89aa-88eb2e9be69c None admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:31.391556 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037d0f9-4e96-4d93-89aa-88eb2e9be69c None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:31.391826 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037d0f9-4e96-4d93-89aa-88eb2e9be69c None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:31.392466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037d0f9-4e96-4d93-89aa-88eb2e9be69c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:31.393853 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037d0f9-4e96-4d93-89aa-88eb2e9be69c None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:31.407494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 643/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Sep 25 00:45:31 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:45:33.523117 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410ef8e-d82b-4399-8124-32f78dcd6e05 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:33.523655 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410ef8e-d82b-4399-8124-32f78dcd6e05 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:33.523655 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410ef8e-d82b-4399-8124-32f78dcd6e05 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:33.525049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 653/1296] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:33.530859 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc265-7dde-4358-827f-9dd187da4d2d None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:33.531301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc265-7dde-4358-827f-9dd187da4d2d None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:33.531469 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc265-7dde-4358-827f-9dd187da4d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:33.552438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-b16fc265-7dde-4358-827f-9dd187da4d2d None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:33.553901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-b16fc265-7dde-4358-827f-9dd187da4d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:33.632014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 644/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:33 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:33.900402 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410ef8e-d82b-4399-8124-32f78dcd6e05 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:33.996896 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410ef8e-d82b-4399-8124-32f78dcd6e05 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:34.030236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d404c-6a79-4b47-af9e-d22af2d19ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:34.030878 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d404c-6a79-4b47-af9e-d22af2d19ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:34.031158 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d404c-6a79-4b47-af9e-d22af2d19ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:34.031432 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d404c-6a79-4b47-af9e-d22af2d19ab2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:34.032012 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d404c-6a79-4b47-af9e-d22af2d19ab2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:34.033394 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d404c-6a79-4b47-af9e-d22af2d19ab2 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-866d404c-6a79-4b47-af9e-d22af2d19ab2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:34.047220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:34.048398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:34.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:34.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:34.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:34.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:34.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:34.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:34.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:34.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:34.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:34.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:34.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:45:34.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:34.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:45:34.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:34.052713 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 654/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Sep 25 00:45:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:34.055695 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fc265-7dde-4358-827f-9dd187da4d2d None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:34.073930 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:34.152776 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fc265-7dde-4358-827f-9dd187da4d2d None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:34.185641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791893d-ab82-4122-8206-d9a1a14d0dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:34.186237 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791893d-ab82-4122-8206-d9a1a14d0dba None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:34.186515 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791893d-ab82-4122-8206-d9a1a14d0dba None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:34.186789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791893d-ab82-4122-8206-d9a1a14d0dba None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:34.187411 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791893d-ab82-4122-8206-d9a1a14d0dba None admin] RBAC: Adding query filter params (name=placement) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:34.187710 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791893d-ab82-4122-8206-d9a1a14d0dba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:34.189117 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791893d-ab82-4122-8206-d9a1a14d0dba None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:34.194575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 645/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Sep 25 00:45:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:34.200406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d404c-6a79-4b47-af9e-d22af2d19ab2 None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:34.231833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:34.297991 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d404c-6a79-4b47-af9e-d22af2d19ab2 None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:34.331037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a1cea-76d6-4b70-9ce5-683c753e124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:34.331629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a1cea-76d6-4b70-9ce5-683c753e124e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:34.331911 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a1cea-76d6-4b70-9ce5-683c753e124e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:34.332205 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a1cea-76d6-4b70-9ce5-683c753e124e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:34.332937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a1cea-76d6-4b70-9ce5-683c753e124e None admin] RBAC: Adding query filter params (interface=public, service_id=425ba85e67014d72aade5117ca01575d, region_id=RegionOne) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:34.333253 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a1cea-76d6-4b70-9ce5-683c753e124e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:34.334612 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a1cea-76d6-4b70-9ce5-683c753e124e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:34.339404 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 655/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Sep 25 00:45:34 2022] GET /identity/v3/endpoints?service_id=425ba85e67014d72aade5117ca01575d&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:34.344895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791893d-ab82-4122-8206-d9a1a14d0dba None admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:34.421810 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:34.440157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791893d-ab82-4122-8206-d9a1a14d0dba None admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:34.472404 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308ea27-06c3-43ce-9fcf-4d5a6624c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:34.473537 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308ea27-06c3-43ce-9fcf-4d5a6624c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:34.473817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308ea27-06c3-43ce-9fcf-4d5a6624c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:34.474089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308ea27-06c3-43ce-9fcf-4d5a6624c6f9 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:34.474683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308ea27-06c3-43ce-9fcf-4d5a6624c6f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:34.476031 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308ea27-06c3-43ce-9fcf-4d5a6624c6f9 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:34.482674 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 646/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Sep 25 00:45:34 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:45:36.594219 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4706f-12dc-42da-8b32-4d10b13e04f7 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:36.594776 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4706f-12dc-42da-8b32-4d10b13e04f7 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:36.594776 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4706f-12dc-42da-8b32-4d10b13e04f7 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:36.596133 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 656/1302] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:36.601776 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4dc10-38e5-40a5-8cd1-506dfec0d69f None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:36.602175 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4dc10-38e5-40a5-8cd1-506dfec0d69f None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:36.602334 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4dc10-38e5-40a5-8cd1-506dfec0d69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:36.620019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-4dd4dc10-38e5-40a5-8cd1-506dfec0d69f None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:36.621244 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-4dd4dc10-38e5-40a5-8cd1-506dfec0d69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:36.685340 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 647/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:36 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:36.949551 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4706f-12dc-42da-8b32-4d10b13e04f7 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:37.049074 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:37.056218 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4706f-12dc-42da-8b32-4d10b13e04f7 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:37.089570 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09d62f-5420-4db5-8439-e24b2520ca5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:37.090191 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09d62f-5420-4db5-8439-e24b2520ca5e None admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:37.090467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09d62f-5420-4db5-8439-e24b2520ca5e None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:37.090739 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09d62f-5420-4db5-8439-e24b2520ca5e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:37.091322 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09d62f-5420-4db5-8439-e24b2520ca5e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:37.092701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09d62f-5420-4db5-8439-e24b2520ca5e None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application [None req-db09d62f-5420-4db5-8439-e24b2520ca5e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:37.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:37.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: ERROR keystone.server.flask.application Sep 25 00:45:37.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 657/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Sep 25 00:45:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:37.108645 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4dc10-38e5-40a5-8cd1-506dfec0d69f None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:37.181984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:37.204598 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4dc10-38e5-40a5-8cd1-506dfec0d69f None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:37.237110 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fea57f-7a17-43b6-824a-bb3a1824e203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:37.237707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fea57f-7a17-43b6-824a-bb3a1824e203 None admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:37.237986 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fea57f-7a17-43b6-824a-bb3a1824e203 None admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:37.238779 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fea57f-7a17-43b6-824a-bb3a1824e203 None admin] PATH_INFO: `/v3/services` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:37.239400 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fea57f-7a17-43b6-824a-bb3a1824e203 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:37.239701 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fea57f-7a17-43b6-824a-bb3a1824e203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:37.241091 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fea57f-7a17-43b6-824a-bb3a1824e203 None admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:37.246029 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 648/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Sep 25 00:45:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:37.251623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09d62f-5420-4db5-8439-e24b2520ca5e None admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:37.348264 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09d62f-5420-4db5-8439-e24b2520ca5e None admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:37.381428 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0afae-25b4-4087-87f3-9ac4a0f303b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:37.382026 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0afae-25b4-4087-87f3-9ac4a0f303b5 None admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:37.382303 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0afae-25b4-4087-87f3-9ac4a0f303b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:37.382577 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0afae-25b4-4087-87f3-9ac4a0f303b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:37.383242 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0afae-25b4-4087-87f3-9ac4a0f303b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:37.385621 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0afae-25b4-4087-87f3-9ac4a0f303b5 None admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:37.408694 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 658/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Sep 25 00:45:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:45:47.243101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=30 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:47.407123 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:40.738320 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dc38f-e87d-4d92-abcf-27ffa30454c2 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:40.738784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dc38f-e87d-4d92-abcf-27ffa30454c2 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:40.738864 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dc38f-e87d-4d92-abcf-27ffa30454c2 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:40.744075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 649/1307] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:46:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:40.745921 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062c823-c116-4ff0-82a8-f803865a6347 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:40.746324 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062c823-c116-4ff0-82a8-f803865a6347 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:40.746548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062c823-c116-4ff0-82a8-f803865a6347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:40.898103 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-6062c823-c116-4ff0-82a8-f803865a6347 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:40.899507 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-6062c823-c116-4ff0-82a8-f803865a6347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:41.044703 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 659/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:46:41.344390 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfa0a5-27e0-4205-a990-eb17b0b4f7a6 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:41.344706 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfa0a5-27e0-4205-a990-eb17b0b4f7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:41.345260 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfa0a5-27e0-4205-a990-eb17b0b4f7a6 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:41.346598 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 650/1309] 10.222.0.27 () {54 vars in 964 bytes} [Sun Sep 25 00:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:41.352596 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb5320-1960-4b19-897d-53ef8c074353 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:41.352889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb5320-1960-4b19-897d-53ef8c074353 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:41.353167 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb5320-1960-4b19-897d-53ef8c074353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:41.442592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-51eb5320-1960-4b19-897d-53ef8c074353 None None] MFA Rules not processed for user `42a2f85512e648698fdc7ab7cac75752`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:41.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-51eb5320-1960-4b19-897d-53ef8c074353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:41.468825 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:41.535498 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 660/1310] 10.222.0.27 () {58 vars in 1061 bytes} [Sun Sep 25 00:46:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:46:41.545221 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfa0a5-27e0-4205-a990-eb17b0b4f7a6 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:41.546680 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-99bfa0a5-27e0-4205-a990-eb17b0b4f7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:41.669745 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfa0a5-27e0-4205-a990-eb17b0b4f7a6 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:41.759933 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6972f7-1d37-4228-9350-6f715667feed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:41.761397 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6972f7-1d37-4228-9350-6f715667feed service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:41.761682 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6972f7-1d37-4228-9350-6f715667feed service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:41.761987 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6972f7-1d37-4228-9350-6f715667feed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:41.763728 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-5b6972f7-1d37-4228-9350-6f715667feed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:41.824365 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:41.883830 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6972f7-1d37-4228-9350-6f715667feed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:41.885644 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6972f7-1d37-4228-9350-6f715667feed service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:41.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 651/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:46:44.409003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e91b0-1417-466f-a0d7-8112f5298973 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:44.409490 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e91b0-1417-466f-a0d7-8112f5298973 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:44.409583 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e91b0-1417-466f-a0d7-8112f5298973 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:44.410889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 661/1312] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:44.416665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d586a-5d3a-45a3-8f55-79d9b981f30f None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:44.417050 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d586a-5d3a-45a3-8f55-79d9b981f30f None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:44.417240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d586a-5d3a-45a3-8f55-79d9b981f30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:44.497822 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-8a8d586a-5d3a-45a3-8f55-79d9b981f30f None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:44.498977 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-8a8d586a-5d3a-45a3-8f55-79d9b981f30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:44.592050 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 652/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:46:44.872530 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e91b0-1417-466f-a0d7-8112f5298973 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:44.874094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-c51e91b0-1417-466f-a0d7-8112f5298973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:44.974063 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e91b0-1417-466f-a0d7-8112f5298973 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:45.043620 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:45.046379 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62703fc-ef49-4381-b11b-3b1c46e2c23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:45.047159 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62703fc-ef49-4381-b11b-3b1c46e2c23b service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:45.047638 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62703fc-ef49-4381-b11b-3b1c46e2c23b service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:45.048107 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62703fc-ef49-4381-b11b-3b1c46e2c23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:45.049768 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-a62703fc-ef49-4381-b11b-3b1c46e2c23b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:45.156421 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62703fc-ef49-4381-b11b-3b1c46e2c23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:45.157901 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62703fc-ef49-4381-b11b-3b1c46e2c23b service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:45.176240 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 662/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:46:47.637398 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6bcff-0bb8-46ae-9f8a-e513dc8442e1 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:47.638201 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6bcff-0bb8-46ae-9f8a-e513dc8442e1 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:47.638385 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6bcff-0bb8-46ae-9f8a-e513dc8442e1 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:47.639778 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 653/1315] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:47.645203 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a1b3-efe3-45c5-b6c3-b1f416a74ae3 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:47.645633 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a1b3-efe3-45c5-b6c3-b1f416a74ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:47.645728 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a1b3-efe3-45c5-b6c3-b1f416a74ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:47.710748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-c2b9a1b3-efe3-45c5-b6c3-b1f416a74ae3 None None] MFA Rules not processed for user `7e42be56f2284bb4ae4095ef96479453`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:47.711947 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-c2b9a1b3-efe3-45c5-b6c3-b1f416a74ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:47.762437 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:47.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 663/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:46:48.103500 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6bcff-0bb8-46ae-9f8a-e513dc8442e1 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:48.105073 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-45a6bcff-0bb8-46ae-9f8a-e513dc8442e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:48.114579 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:48.206816 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6bcff-0bb8-46ae-9f8a-e513dc8442e1 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:48.277343 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4229b-2bc5-4015-8668-d147acfc8f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:48.277939 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4229b-2bc5-4015-8668-d147acfc8f9e service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:48.278214 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4229b-2bc5-4015-8668-d147acfc8f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:48.278479 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4229b-2bc5-4015-8668-d147acfc8f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:48.280045 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-36c4229b-2bc5-4015-8668-d147acfc8f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:48.340781 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:48.386909 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4229b-2bc5-4015-8668-d147acfc8f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:48.388336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4229b-2bc5-4015-8668-d147acfc8f9e service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:48.405926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 654/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:46:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:46:51.092019 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a136d7b-3a27-466f-a062-e5c393223b31 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:51.092545 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a136d7b-3a27-466f-a062-e5c393223b31 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:51.092545 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a136d7b-3a27-466f-a062-e5c393223b31 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:51.093858 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 664/1318] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:51.099161 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c5d7a-a592-484c-8f3c-4fecb08922b2 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:51.099586 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c5d7a-a592-484c-8f3c-4fecb08922b2 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:51.099703 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c5d7a-a592-484c-8f3c-4fecb08922b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:51.165248 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-2c4c5d7a-a592-484c-8f3c-4fecb08922b2 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:51.166465 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-2c4c5d7a-a592-484c-8f3c-4fecb08922b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:51.260342 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 655/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:46:51.542594 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a136d7b-3a27-466f-a062-e5c393223b31 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:51.544385 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-1a136d7b-3a27-466f-a062-e5c393223b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:51.645119 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a136d7b-3a27-466f-a062-e5c393223b31 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:51.716113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f7efc-4694-4e23-8e5d-3af22d703a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:51.716733 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f7efc-4694-4e23-8e5d-3af22d703a9f service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:51.717008 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f7efc-4694-4e23-8e5d-3af22d703a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:51.717276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f7efc-4694-4e23-8e5d-3af22d703a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:51.718837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-ff0f7efc-4694-4e23-8e5d-3af22d703a9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:51.725438 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:51.825126 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f7efc-4694-4e23-8e5d-3af22d703a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:51.826406 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f7efc-4694-4e23-8e5d-3af22d703a9f service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:51.844308 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 665/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:46:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:46:54.690215 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be134a7-31ec-4830-8025-f1e2aa744657 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:54.690842 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be134a7-31ec-4830-8025-f1e2aa744657 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:54.690842 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be134a7-31ec-4830-8025-f1e2aa744657 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:54.692129 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 656/1321] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:54.698685 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ab0fb-c81a-4a8a-8855-33d98b7931a6 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:54.699217 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ab0fb-c81a-4a8a-8855-33d98b7931a6 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:54.699389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ab0fb-c81a-4a8a-8855-33d98b7931a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:54.775400 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-1f6ab0fb-c81a-4a8a-8855-33d98b7931a6 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:54.776645 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-1f6ab0fb-c81a-4a8a-8855-33d98b7931a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:54.840751 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:54.882094 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 666/1322] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:46:55.169280 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be134a7-31ec-4830-8025-f1e2aa744657 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:55.170852 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-2be134a7-31ec-4830-8025-f1e2aa744657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:55.190646 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:55.274696 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be134a7-31ec-4830-8025-f1e2aa744657 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:55.348204 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d4bb4-8343-405c-9862-3a9d4331533b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:55.348832 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d4bb4-8343-405c-9862-3a9d4331533b service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:55.349104 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d4bb4-8343-405c-9862-3a9d4331533b service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:55.349370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d4bb4-8343-405c-9862-3a9d4331533b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:55.350946 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-0b9d4bb4-8343-405c-9862-3a9d4331533b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:55.424068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:55.461850 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d4bb4-8343-405c-9862-3a9d4331533b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:55.463376 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d4bb4-8343-405c-9862-3a9d4331533b service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:55.481569 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 657/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:46:57.709335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83c088-706e-4fdf-8524-332866716d65 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:57.709865 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83c088-706e-4fdf-8524-332866716d65 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:57.709865 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83c088-706e-4fdf-8524-332866716d65 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:57.711208 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 667/1324] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:57.716480 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d02e8-05e9-465b-8061-1b6f4d0f100d None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:57.716945 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d02e8-05e9-465b-8061-1b6f4d0f100d None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:57.717075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d02e8-05e9-465b-8061-1b6f4d0f100d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:57.791772 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-5e7d02e8-05e9-465b-8061-1b6f4d0f100d None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:57.793285 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-5e7d02e8-05e9-465b-8061-1b6f4d0f100d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:57.892402 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 658/1325] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:46:58.172024 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83c088-706e-4fdf-8524-332866716d65 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:58.173637 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-fb83c088-706e-4fdf-8524-332866716d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:58.276436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83c088-706e-4fdf-8524-332866716d65 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:58.352802 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebec4ba-4bd1-4c99-b6a0-41079e243165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:58.353401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebec4ba-4bd1-4c99-b6a0-41079e243165 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:58.353674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebec4ba-4bd1-4c99-b6a0-41079e243165 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:58.353942 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebec4ba-4bd1-4c99-b6a0-41079e243165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:58.355530 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-6ebec4ba-4bd1-4c99-b6a0-41079e243165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:58.373220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:58.465610 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebec4ba-4bd1-4c99-b6a0-41079e243165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:58.466959 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebec4ba-4bd1-4c99-b6a0-41079e243165 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:58.485579 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 668/1326] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:47:00.667471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78640e44-db4a-413a-b638-20e764111c9a None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:00.668274 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78640e44-db4a-413a-b638-20e764111c9a None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:00.668274 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78640e44-db4a-413a-b638-20e764111c9a None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:00.669590 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 659/1327] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:00.674739 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22691b0-470d-4516-bb82-e7d3c6836d9f None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:00.675106 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22691b0-470d-4516-bb82-e7d3c6836d9f None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:00.675267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22691b0-470d-4516-bb82-e7d3c6836d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:00.741686 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-b22691b0-470d-4516-bb82-e7d3c6836d9f None None] MFA Rules not processed for user `7e42be56f2284bb4ae4095ef96479453`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:00.742887 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-b22691b0-470d-4516-bb82-e7d3c6836d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:00.806336 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:00.838843 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 669/1328] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:00 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:01.124396 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78640e44-db4a-413a-b638-20e764111c9a None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:01.126048 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-78640e44-db4a-413a-b638-20e764111c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:01.159530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:01.235009 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78640e44-db4a-413a-b638-20e764111c9a None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:01.307320 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c379754-79b9-4f6c-b173-70cea2258fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:01.307922 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c379754-79b9-4f6c-b173-70cea2258fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:01.308195 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c379754-79b9-4f6c-b173-70cea2258fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:01.308465 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c379754-79b9-4f6c-b173-70cea2258fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:01.310069 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-3c379754-79b9-4f6c-b173-70cea2258fe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:01.391294 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:01.423944 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c379754-79b9-4f6c-b173-70cea2258fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:01.425415 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c379754-79b9-4f6c-b173-70cea2258fe3 service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:01.443570 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 660/1329] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:47:03.816535 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ec8cc-0b86-483a-91d4-cfcc13a8d5e2 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:03.817117 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ec8cc-0b86-483a-91d4-cfcc13a8d5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:03.817117 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ec8cc-0b86-483a-91d4-cfcc13a8d5e2 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:03.818425 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 670/1330] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:03.823710 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad992858-90c6-4748-828c-3c782767d864 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:03.824153 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad992858-90c6-4748-828c-3c782767d864 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:03.824327 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad992858-90c6-4748-828c-3c782767d864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:03.888399 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-ad992858-90c6-4748-828c-3c782767d864 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:03.889629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-ad992858-90c6-4748-828c-3c782767d864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:03.984451 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 661/1331] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:47:04.263636 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ec8cc-0b86-483a-91d4-cfcc13a8d5e2 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:04.265180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-d93ec8cc-0b86-483a-91d4-cfcc13a8d5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:04.366197 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ec8cc-0b86-483a-91d4-cfcc13a8d5e2 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:04.440037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3908d-320f-4778-968b-7cfb5b992dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:04.440679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3908d-320f-4778-968b-7cfb5b992dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:04.440951 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3908d-320f-4778-968b-7cfb5b992dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:04.441217 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3908d-320f-4778-968b-7cfb5b992dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:04.442791 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-40f3908d-320f-4778-968b-7cfb5b992dd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:04.469496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:04.549934 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3908d-320f-4778-968b-7cfb5b992dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:04.551295 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3908d-320f-4778-968b-7cfb5b992dd7 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:04.569543 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 671/1332] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:47:06.738599 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9272c21-059c-40d1-a334-a2ae991348d0 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:06.739134 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9272c21-059c-40d1-a334-a2ae991348d0 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:06.739134 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9272c21-059c-40d1-a334-a2ae991348d0 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:06.740494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 662/1333] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:06.746227 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bded2-f534-4a31-86aa-b6f236b101f5 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:06.746621 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bded2-f534-4a31-86aa-b6f236b101f5 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:06.746776 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bded2-f534-4a31-86aa-b6f236b101f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:06.810105 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-b88bded2-f534-4a31-86aa-b6f236b101f5 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:06.811296 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-b88bded2-f534-4a31-86aa-b6f236b101f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:06.883804 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:06.904904 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 672/1334] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:07.188710 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9272c21-059c-40d1-a334-a2ae991348d0 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:07.190328 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-c9272c21-059c-40d1-a334-a2ae991348d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:07.231455 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:07.293913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9272c21-059c-40d1-a334-a2ae991348d0 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:07.366418 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde29245-f29a-4a9a-8a41-ba81dceb33b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:07.367029 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde29245-f29a-4a9a-8a41-ba81dceb33b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:07.367311 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde29245-f29a-4a9a-8a41-ba81dceb33b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:07.367581 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde29245-f29a-4a9a-8a41-ba81dceb33b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:07.369219 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-cde29245-f29a-4a9a-8a41-ba81dceb33b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:07.457339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:07.489935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde29245-f29a-4a9a-8a41-ba81dceb33b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:07.491369 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde29245-f29a-4a9a-8a41-ba81dceb33b2 service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:07.510286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 663/1335] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:47:09.997909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d62ec-544c-4e5d-b338-87ca1af1d3d7 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:09.998465 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d62ec-544c-4e5d-b338-87ca1af1d3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:09.998465 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d62ec-544c-4e5d-b338-87ca1af1d3d7 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:09.999796 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 673/1336] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:10.004949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c480e-3f67-4b24-b8c5-1be3692eda17 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:10.005366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c480e-3f67-4b24-b8c5-1be3692eda17 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:10.005476 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c480e-3f67-4b24-b8c5-1be3692eda17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:10.069592 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-b80c480e-3f67-4b24-b8c5-1be3692eda17 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:10.070784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-b80c480e-3f67-4b24-b8c5-1be3692eda17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:10.171085 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 664/1337] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:10.449891 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d62ec-544c-4e5d-b338-87ca1af1d3d7 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:10.451441 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-126d62ec-544c-4e5d-b338-87ca1af1d3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:10.557229 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d62ec-544c-4e5d-b338-87ca1af1d3d7 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:10.628920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66146c13-4cde-4fea-885d-a0830ca3bdaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:10.629524 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146c13-4cde-4fea-885d-a0830ca3bdaa service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:10.629800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146c13-4cde-4fea-885d-a0830ca3bdaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:10.630080 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146c13-4cde-4fea-885d-a0830ca3bdaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:10.632216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-66146c13-4cde-4fea-885d-a0830ca3bdaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:10.668098 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:10.738777 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66146c13-4cde-4fea-885d-a0830ca3bdaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:10.740165 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66146c13-4cde-4fea-885d-a0830ca3bdaa service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:10.758019 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 674/1338] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:47:14.808897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fa95c-ad9c-497d-8391-63b6303cef66 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:14.809488 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fa95c-ad9c-497d-8391-63b6303cef66 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:14.809488 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fa95c-ad9c-497d-8391-63b6303cef66 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:14.812702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 665/1339] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:14.816329 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7777a-6d1b-404a-833f-9c71df34f7c3 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:14.816796 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7777a-6d1b-404a-833f-9c71df34f7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:14.816908 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7777a-6d1b-404a-833f-9c71df34f7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:14.882996 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-8db7777a-6d1b-404a-833f-9c71df34f7c3 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:14.884130 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-8db7777a-6d1b-404a-833f-9c71df34f7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:14.969523 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:14.982109 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 675/1340] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:15.266136 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fa95c-ad9c-497d-8391-63b6303cef66 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:15.267667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-263fa95c-ad9c-497d-8391-63b6303cef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:15.316152 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:15.373109 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fa95c-ad9c-497d-8391-63b6303cef66 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:15.448178 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26f03a-b49a-4b37-be48-04283cd1c204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:15.448814 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26f03a-b49a-4b37-be48-04283cd1c204 service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:15.449093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26f03a-b49a-4b37-be48-04283cd1c204 service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:15.449362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26f03a-b49a-4b37-be48-04283cd1c204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:15.450944 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-fb26f03a-b49a-4b37-be48-04283cd1c204 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:15.545677 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:15.562502 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26f03a-b49a-4b37-be48-04283cd1c204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:15.563951 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26f03a-b49a-4b37-be48-04283cd1c204 service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:15.582100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 666/1341] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:47:18.357303 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe22bb5-7774-4919-9c1a-110c397f0688 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:18.357883 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe22bb5-7774-4919-9c1a-110c397f0688 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:18.357883 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe22bb5-7774-4919-9c1a-110c397f0688 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:18.359294 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 676/1342] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:18.364544 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9a5b1-40b3-43ae-bfd8-c50009e1ebae None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:18.364967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9a5b1-40b3-43ae-bfd8-c50009e1ebae None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:18.365160 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9a5b1-40b3-43ae-bfd8-c50009e1ebae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:18.430778 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-31a9a5b1-40b3-43ae-bfd8-c50009e1ebae None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:18.431989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-31a9a5b1-40b3-43ae-bfd8-c50009e1ebae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:18.526788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 667/1343] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:18.817903 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe22bb5-7774-4919-9c1a-110c397f0688 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:18.819453 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-1fe22bb5-7774-4919-9c1a-110c397f0688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:18.938297 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe22bb5-7774-4919-9c1a-110c397f0688 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:19.012691 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c36e7-fd1f-4a89-be55-837d14215b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:19.013293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c36e7-fd1f-4a89-be55-837d14215b81 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:19.013565 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c36e7-fd1f-4a89-be55-837d14215b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:19.013833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c36e7-fd1f-4a89-be55-837d14215b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:19.015414 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-1d9c36e7-fd1f-4a89-be55-837d14215b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:19.062469 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:19.128973 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c36e7-fd1f-4a89-be55-837d14215b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:19.131040 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c36e7-fd1f-4a89-be55-837d14215b81 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:19.150324 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 677/1344] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:47:23.296212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb0d7c-32ce-47f3-8b2e-448043e2eeea None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:23.296736 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb0d7c-32ce-47f3-8b2e-448043e2eeea None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:23.296842 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb0d7c-32ce-47f3-8b2e-448043e2eeea None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:23.298414 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 668/1345] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:23.304363 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2bd6a-ecca-4c9b-b024-f363af89adda None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:23.304829 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2bd6a-ecca-4c9b-b024-f363af89adda None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:23.304990 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2bd6a-ecca-4c9b-b024-f363af89adda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:23.371341 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-29e2bd6a-ecca-4c9b-b024-f363af89adda None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:23.372566 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-29e2bd6a-ecca-4c9b-b024-f363af89adda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:23.464652 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:23.466900 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 678/1346] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:23.756240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb0d7c-32ce-47f3-8b2e-448043e2eeea None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:23.757843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-3edb0d7c-32ce-47f3-8b2e-448043e2eeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:23.818789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:23.863950 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb0d7c-32ce-47f3-8b2e-448043e2eeea None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:23.936059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6001-e228-4d67-a182-2b9460fc1b9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:23.936682 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6001-e228-4d67-a182-2b9460fc1b9b service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:23.936957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6001-e228-4d67-a182-2b9460fc1b9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:23.937232 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6001-e228-4d67-a182-2b9460fc1b9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:23.938813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-381e6001-e228-4d67-a182-2b9460fc1b9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:24.040871 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:24.045013 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e6001-e228-4d67-a182-2b9460fc1b9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:24.046453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e6001-e228-4d67-a182-2b9460fc1b9b service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:24.064868 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 669/1347] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:47:28.931277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d776f4d-b64e-47b5-869d-63dcb74255c4 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:28.931719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d776f4d-b64e-47b5-869d-63dcb74255c4 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:28.931719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d776f4d-b64e-47b5-869d-63dcb74255c4 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:28.938028 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7336e4f-e2e8-46d2-b960-40c0c7829007 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:28.938920 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7336e4f-e2e8-46d2-b960-40c0c7829007 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:28.941020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 679/1348] 10.222.0.27 () {54 vars in 921 bytes} [Sun Sep 25 00:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:28.941265 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7336e4f-e2e8-46d2-b960-40c0c7829007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:29.059040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-c7336e4f-e2e8-46d2-b960-40c0c7829007 None None] MFA Rules not processed for user `bac1aba93232486eb2bd5b3200cb6fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:29.060638 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-c7336e4f-e2e8-46d2-b960-40c0c7829007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:29.244288 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 670/1349] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Sep 25 00:47:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:33.320129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bec9e1-76ef-410f-bbb7-dca16da0f35b None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:33.320900 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bec9e1-76ef-410f-bbb7-dca16da0f35b None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:33.320900 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bec9e1-76ef-410f-bbb7-dca16da0f35b None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:33.322315 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 680/1350] 10.222.0.27 () {54 vars in 921 bytes} [Sun Sep 25 00:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:33.327393 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52175e2f-8eda-4d17-adef-d9bb5d37fdcc None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:33.328188 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52175e2f-8eda-4d17-adef-d9bb5d37fdcc None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:33.328731 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52175e2f-8eda-4d17-adef-d9bb5d37fdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:33.391001 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:33.422527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-52175e2f-8eda-4d17-adef-d9bb5d37fdcc None None] MFA Rules not processed for user `bac1aba93232486eb2bd5b3200cb6fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:33.424145 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-52175e2f-8eda-4d17-adef-d9bb5d37fdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:33.542061 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 671/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Sep 25 00:47:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:34.911412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901ceb5-2666-4346-81f6-80010a037027 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:34.911926 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901ceb5-2666-4346-81f6-80010a037027 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:34.912015 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901ceb5-2666-4346-81f6-80010a037027 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:34.913618 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 681/1352] 10.222.0.27 () {54 vars in 921 bytes} [Sun Sep 25 00:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:34.918682 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a59c2-9900-4765-8242-e379cb09e4dc None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:34.919116 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a59c2-9900-4765-8242-e379cb09e4dc None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:34.919257 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a59c2-9900-4765-8242-e379cb09e4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:34.995203 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-7f8a59c2-9900-4765-8242-e379cb09e4dc None None] MFA Rules not processed for user `bac1aba93232486eb2bd5b3200cb6fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:34.996399 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-7f8a59c2-9900-4765-8242-e379cb09e4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:35.038919 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:35.105315 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 672/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Sep 25 00:47:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:47:38.664434 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ea53c-cf07-4ffc-a352-95a66197e4e0 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:38.664993 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ea53c-cf07-4ffc-a352-95a66197e4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:38.665078 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ea53c-cf07-4ffc-a352-95a66197e4e0 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:38.666353 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 682/1354] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:38.671914 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ab7bf-4953-4eec-8fd9-48c3f445aff2 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:38.672407 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ab7bf-4953-4eec-8fd9-48c3f445aff2 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:38.672491 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ab7bf-4953-4eec-8fd9-48c3f445aff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:38.743900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-1b2ab7bf-4953-4eec-8fd9-48c3f445aff2 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:38.745275 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-1b2ab7bf-4953-4eec-8fd9-48c3f445aff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:38.856623 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 673/1355] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:39.168467 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b3e4b-240e-4ec2-a9f7-8b151e8b0c68 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:39.169058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b3e4b-240e-4ec2-a9f7-8b151e8b0c68 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:39.170246 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b3e4b-240e-4ec2-a9f7-8b151e8b0c68 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:39.172286 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 683/1356] 10.222.0.27 () {54 vars in 961 bytes} [Sun Sep 25 00:47:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:39.183306 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779ddb-e092-474a-8f13-04b536614711 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:39.184303 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779ddb-e092-474a-8f13-04b536614711 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:39.185277 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779ddb-e092-474a-8f13-04b536614711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:39.204805 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:39.271936 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-12779ddb-e092-474a-8f13-04b536614711 None None] MFA Rules not processed for user `d494b82a81ca42a69fe7d9efc2f2a251`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:39.273415 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-12779ddb-e092-474a-8f13-04b536614711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:39.400268 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 674/1357] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Sep 25 00:47:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:39.408480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b3e4b-240e-4ec2-a9f7-8b151e8b0c68 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:39.410029 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-9a9b3e4b-240e-4ec2-a9f7-8b151e8b0c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:39.574380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b3e4b-240e-4ec2-a9f7-8b151e8b0c68 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:39.651645 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:39.695841 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98685257-02d9-443b-8437-de450574c6f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:39.696515 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98685257-02d9-443b-8437-de450574c6f1 service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:39.696799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98685257-02d9-443b-8437-de450574c6f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:39.697041 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98685257-02d9-443b-8437-de450574c6f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:39.698637 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-98685257-02d9-443b-8437-de450574c6f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:39.799290 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98685257-02d9-443b-8437-de450574c6f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:39.800960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98685257-02d9-443b-8437-de450574c6f1 service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:39.825898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 684/1358] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 00:47:42.214976 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d73575-b313-4595-8792-7bd38a0ca6e7 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:42.215496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d73575-b313-4595-8792-7bd38a0ca6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:42.215496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d73575-b313-4595-8792-7bd38a0ca6e7 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:42.217948 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 675/1359] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:42.227310 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1ddcd-1b66-42a1-8dd6-94a0469482ee None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:42.227310 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1ddcd-1b66-42a1-8dd6-94a0469482ee None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:42.227310 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1ddcd-1b66-42a1-8dd6-94a0469482ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:42.301132 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-81b1ddcd-1b66-42a1-8dd6-94a0469482ee None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:42.302436 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-81b1ddcd-1b66-42a1-8dd6-94a0469482ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:42.348373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:42.409425 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 685/1360] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:42.718017 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d73575-b313-4595-8792-7bd38a0ca6e7 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:42.720080 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-19d73575-b313-4595-8792-7bd38a0ca6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:42.786368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:42.901730 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d73575-b313-4595-8792-7bd38a0ca6e7 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:43.047235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20404944-328b-4bd8-9ed4-4fa42ee41366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:43.048423 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20404944-328b-4bd8-9ed4-4fa42ee41366 service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:43.048786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20404944-328b-4bd8-9ed4-4fa42ee41366 service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:43.049063 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20404944-328b-4bd8-9ed4-4fa42ee41366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:43.050711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-20404944-328b-4bd8-9ed4-4fa42ee41366 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:43.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:43.147747 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20404944-328b-4bd8-9ed4-4fa42ee41366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:43.149409 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20404944-328b-4bd8-9ed4-4fa42ee41366 service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:43.168356 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 676/1361] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:47:45.651441 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153edf6-31cd-442a-93e4-6921e4205538 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:45.651999 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153edf6-31cd-442a-93e4-6921e4205538 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:45.651999 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153edf6-31cd-442a-93e4-6921e4205538 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:45.653339 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 686/1362] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:45.658800 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec50d0-cb81-453b-b38a-cb8cd3d2f8ad None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:45.659544 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec50d0-cb81-453b-b38a-cb8cd3d2f8ad None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:45.659822 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec50d0-cb81-453b-b38a-cb8cd3d2f8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:45.726043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-49ec50d0-cb81-453b-b38a-cb8cd3d2f8ad None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:45.727377 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-49ec50d0-cb81-453b-b38a-cb8cd3d2f8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:45.827731 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:45.837269 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 677/1363] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:46.119438 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f940001-71b3-4d0b-892a-5a53851535f2 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:46.119850 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f940001-71b3-4d0b-892a-5a53851535f2 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:46.120220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f940001-71b3-4d0b-892a-5a53851535f2 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:46.121901 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 687/1364] 10.222.0.27 () {54 vars in 961 bytes} [Sun Sep 25 00:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:46.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660cbf2-50f7-4e6f-af84-9ac2bfae5f42 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:46.127735 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660cbf2-50f7-4e6f-af84-9ac2bfae5f42 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:46.128014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660cbf2-50f7-4e6f-af84-9ac2bfae5f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:46.206433 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-c660cbf2-50f7-4e6f-af84-9ac2bfae5f42 None None] MFA Rules not processed for user `d494b82a81ca42a69fe7d9efc2f2a251`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:46.207626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-c660cbf2-50f7-4e6f-af84-9ac2bfae5f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:46.329575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 678/1365] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Sep 25 00:47:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:46.338129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f940001-71b3-4d0b-892a-5a53851535f2 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:46.339864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-2f940001-71b3-4d0b-892a-5a53851535f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:46.501305 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f940001-71b3-4d0b-892a-5a53851535f2 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:46.523752 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:46.623547 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14dc8c-950f-4f18-8d54-b071905c6070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:46.624154 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14dc8c-950f-4f18-8d54-b071905c6070 service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:46.624441 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14dc8c-950f-4f18-8d54-b071905c6070 service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:46.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14dc8c-950f-4f18-8d54-b071905c6070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:46.626877 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-2d14dc8c-950f-4f18-8d54-b071905c6070 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:46.728005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14dc8c-950f-4f18-8d54-b071905c6070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:46.729638 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14dc8c-950f-4f18-8d54-b071905c6070 service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:46.749002 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 688/1366] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:47:46.814788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ede64b-15b6-464b-9077-2b079552fb4e None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:46.815286 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ede64b-15b6-464b-9077-2b079552fb4e None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:46.815366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ede64b-15b6-464b-9077-2b079552fb4e None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:46.817457 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 679/1367] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:46.822856 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7bb9-3a17-4dc4-8b23-bc4ab1aec7d7 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:46.823297 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7bb9-3a17-4dc4-8b23-bc4ab1aec7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:46.823578 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7bb9-3a17-4dc4-8b23-bc4ab1aec7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:46.869543 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:46.912345 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-163d7bb9-3a17-4dc4-8b23-bc4ab1aec7d7 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:46.913629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-163d7bb9-3a17-4dc4-8b23-bc4ab1aec7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:47.032333 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 689/1368] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:47.333281 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007146a8-46f1-49d9-8f97-272a52a5d004 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:47.333693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007146a8-46f1-49d9-8f97-272a52a5d004 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:47.334095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007146a8-46f1-49d9-8f97-272a52a5d004 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:47.335697 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 680/1369] 10.222.0.27 () {54 vars in 963 bytes} [Sun Sep 25 00:47:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:47.341202 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70b288-a73c-4061-a63c-260d9a5c02ba None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:47.341492 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70b288-a73c-4061-a63c-260d9a5c02ba None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:47.341767 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70b288-a73c-4061-a63c-260d9a5c02ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:47.422320 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-1e70b288-a73c-4061-a63c-260d9a5c02ba None None] MFA Rules not processed for user `41cd0c4bf9734339ba9e8f2dabb9a0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:47.423498 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-1e70b288-a73c-4061-a63c-260d9a5c02ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:47.470927 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:47.503245 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 690/1370] 10.222.0.27 () {58 vars in 1060 bytes} [Sun Sep 25 00:47:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:47.510571 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007146a8-46f1-49d9-8f97-272a52a5d004 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:47.512077 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-007146a8-46f1-49d9-8f97-272a52a5d004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:47.567680 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:47.627251 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007146a8-46f1-49d9-8f97-272a52a5d004 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:47.706009 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd817b-46cf-4377-841f-3d8c9616ba4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41cd0c4bf9734339ba9e8f2dabb9a0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:47.706793 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd817b-46cf-4377-841f-3d8c9616ba4c service cinder] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:47.707148 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd817b-46cf-4377-841f-3d8c9616ba4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:47.707552 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd817b-46cf-4377-841f-3d8c9616ba4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:47.709281 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-72bd817b-46cf-4377-841f-3d8c9616ba4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:47.828774 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:47.856326 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd817b-46cf-4377-841f-3d8c9616ba4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:47.859180 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd817b-46cf-4377-841f-3d8c9616ba4c service cinder] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:47.893261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 681/1371] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:47:48.987473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab342f8-9ef5-40ee-92d9-bab5427f6df9 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:48.988001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab342f8-9ef5-40ee-92d9-bab5427f6df9 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:48.988108 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab342f8-9ef5-40ee-92d9-bab5427f6df9 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:48.989482 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 691/1372] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:48.994836 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29885a-1046-4bf5-8a19-217756d79303 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:48.995250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29885a-1046-4bf5-8a19-217756d79303 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:48.995372 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29885a-1046-4bf5-8a19-217756d79303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:49.059737 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-9b29885a-1046-4bf5-8a19-217756d79303 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:49.060978 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-9b29885a-1046-4bf5-8a19-217756d79303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:49.158543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 682/1373] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:49.448376 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab342f8-9ef5-40ee-92d9-bab5427f6df9 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:49.450012 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-cab342f8-9ef5-40ee-92d9-bab5427f6df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:49.609471 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab342f8-9ef5-40ee-92d9-bab5427f6df9 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:49.674783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:49.742899 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2bdf9-6396-4f6e-bb77-96ce6511b000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:49.743429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2bdf9-6396-4f6e-bb77-96ce6511b000 service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:49.743706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2bdf9-6396-4f6e-bb77-96ce6511b000 service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:49.743973 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2bdf9-6396-4f6e-bb77-96ce6511b000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:49.745623 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-b2a2bdf9-6396-4f6e-bb77-96ce6511b000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:49.842234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2bdf9-6396-4f6e-bb77-96ce6511b000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:49.844046 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2bdf9-6396-4f6e-bb77-96ce6511b000 service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:49.864586 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 692/1374] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:47:52.088327 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872ee88-b56c-4181-8cf5-01d632c74c1d None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:52.088867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872ee88-b56c-4181-8cf5-01d632c74c1d None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:52.089068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872ee88-b56c-4181-8cf5-01d632c74c1d None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:52.090507 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 683/1375] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:52.096375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd676747-5548-4177-9782-47bb27149075 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:52.096823 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd676747-5548-4177-9782-47bb27149075 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:52.097096 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd676747-5548-4177-9782-47bb27149075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:52.171742 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-fd676747-5548-4177-9782-47bb27149075 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:52.172987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-fd676747-5548-4177-9782-47bb27149075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:52.180604 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:52.275389 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 693/1376] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:52.563520 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872ee88-b56c-4181-8cf5-01d632c74c1d None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:52.565184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-8872ee88-b56c-4181-8cf5-01d632c74c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:52.641273 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:52.740317 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872ee88-b56c-4181-8cf5-01d632c74c1d None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:52.869212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad037d7c-bdac-442d-88f3-9837490f20a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:52.869966 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad037d7c-bdac-442d-88f3-9837490f20a9 service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:52.870359 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad037d7c-bdac-442d-88f3-9837490f20a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:52.870727 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad037d7c-bdac-442d-88f3-9837490f20a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:52.872409 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-ad037d7c-bdac-442d-88f3-9837490f20a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:52.892939 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:52.973396 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad037d7c-bdac-442d-88f3-9837490f20a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:52.975255 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad037d7c-bdac-442d-88f3-9837490f20a9 service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:52.997459 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 684/1377] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:47:55.246367 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7adbb-21de-4d60-be6c-f73f1c5f6870 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:55.246824 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7adbb-21de-4d60-be6c-f73f1c5f6870 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:55.246992 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7adbb-21de-4d60-be6c-f73f1c5f6870 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:55.248767 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 694/1378] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:55.254808 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd6159-866c-4e32-8a2b-cf46978a0c32 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:55.255217 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd6159-866c-4e32-8a2b-cf46978a0c32 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:55.255217 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd6159-866c-4e32-8a2b-cf46978a0c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:55.351401 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-75bd6159-866c-4e32-8a2b-cf46978a0c32 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:55.353478 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-75bd6159-866c-4e32-8a2b-cf46978a0c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:55.459104 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:55.466157 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 685/1379] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:55.831038 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7adbb-21de-4d60-be6c-f73f1c5f6870 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:55.833043 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-e4a7adbb-21de-4d60-be6c-f73f1c5f6870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:55.990485 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:56.003531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7adbb-21de-4d60-be6c-f73f1c5f6870 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:56.148308 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4805c4-50f8-409a-a7e7-95cc4e8d173c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:56.149267 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4805c4-50f8-409a-a7e7-95cc4e8d173c service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:56.149628 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4805c4-50f8-409a-a7e7-95cc4e8d173c service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:56.149944 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4805c4-50f8-409a-a7e7-95cc4e8d173c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:56.151999 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-4f4805c4-50f8-409a-a7e7-95cc4e8d173c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:56.266401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4805c4-50f8-409a-a7e7-95cc4e8d173c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:56.268742 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4805c4-50f8-409a-a7e7-95cc4e8d173c service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:56.283105 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:56.296937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 695/1380] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:47:58.561069 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e09bd4-e45f-4dc9-a2b0-03c09dbf083a None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:58.561770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e09bd4-e45f-4dc9-a2b0-03c09dbf083a None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:58.561770 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e09bd4-e45f-4dc9-a2b0-03c09dbf083a None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:58.564094 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 686/1381] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:47:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:58.570571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c3c39-688a-4d8b-b7b5-469df152d467 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:58.571157 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c3c39-688a-4d8b-b7b5-469df152d467 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:58.571281 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c3c39-688a-4d8b-b7b5-469df152d467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:58.644089 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-c27c3c39-688a-4d8b-b7b5-469df152d467 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:58.645822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-c27c3c39-688a-4d8b-b7b5-469df152d467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:58.775120 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 696/1382] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:47:59.066921 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e09bd4-e45f-4dc9-a2b0-03c09dbf083a None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:59.068459 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-19e09bd4-e45f-4dc9-a2b0-03c09dbf083a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:59.241061 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e09bd4-e45f-4dc9-a2b0-03c09dbf083a None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:59.326889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:59.387773 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb96a48-69c5-43a5-92ec-5b2b827cbe5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:59.388583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb96a48-69c5-43a5-92ec-5b2b827cbe5e service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:59.388938 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb96a48-69c5-43a5-92ec-5b2b827cbe5e service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:59.389276 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb96a48-69c5-43a5-92ec-5b2b827cbe5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:59.391385 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-ceb96a48-69c5-43a5-92ec-5b2b827cbe5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:59.486117 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb96a48-69c5-43a5-92ec-5b2b827cbe5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:59.487724 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb96a48-69c5-43a5-92ec-5b2b827cbe5e service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:59.505996 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 687/1383] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:01.674432 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b887ef-3195-46fc-ba6a-0a1d59fa4d0b None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:01.674992 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b887ef-3195-46fc-ba6a-0a1d59fa4d0b None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:01.674992 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b887ef-3195-46fc-ba6a-0a1d59fa4d0b None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:01.676317 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 697/1384] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:01.681521 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418ffc1-8d81-4b42-815d-1e4a0845265e None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:01.681941 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418ffc1-8d81-4b42-815d-1e4a0845265e None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:01.682093 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418ffc1-8d81-4b42-815d-1e4a0845265e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:01.748977 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-b418ffc1-8d81-4b42-815d-1e4a0845265e None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:01.750201 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-b418ffc1-8d81-4b42-815d-1e4a0845265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:01.783200 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:01.853114 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 688/1385] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:02.143060 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b887ef-3195-46fc-ba6a-0a1d59fa4d0b None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:02.144609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-56b887ef-3195-46fc-ba6a-0a1d59fa4d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:02.221456 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:02.290723 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b887ef-3195-46fc-ba6a-0a1d59fa4d0b None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:02.403576 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a4ae1-1a79-46d0-b635-6354c9abd679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:02.404714 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a4ae1-1a79-46d0-b635-6354c9abd679 service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:02.404997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a4ae1-1a79-46d0-b635-6354c9abd679 service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:02.405264 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a4ae1-1a79-46d0-b635-6354c9abd679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:02.406844 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-ad1a4ae1-1a79-46d0-b635-6354c9abd679 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:02.444910 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:02.495566 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a4ae1-1a79-46d0-b635-6354c9abd679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:02.497234 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a4ae1-1a79-46d0-b635-6354c9abd679 service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:02.514851 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 698/1386] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:03.107272 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae1bdb-8a70-4e4d-83b9-4372a987027f None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:03.107808 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae1bdb-8a70-4e4d-83b9-4372a987027f None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:03.107808 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae1bdb-8a70-4e4d-83b9-4372a987027f None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:03.109116 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 689/1387] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:03.114250 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661ce27-d121-45ca-a32e-5375462660eb None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:03.114725 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661ce27-d121-45ca-a32e-5375462660eb None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:03.114833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661ce27-d121-45ca-a32e-5375462660eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:03.180877 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-6661ce27-d121-45ca-a32e-5375462660eb None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:03.182089 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-6661ce27-d121-45ca-a32e-5375462660eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:03.281237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 699/1388] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:03.581105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02e86-cb1f-4c96-ab14-bfa9e86c6434 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:03.581391 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02e86-cb1f-4c96-ab14-bfa9e86c6434 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:03.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02e86-cb1f-4c96-ab14-bfa9e86c6434 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:03.582983 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 690/1389] 10.222.0.27 () {54 vars in 962 bytes} [Sun Sep 25 00:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:03.588243 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fabc6-47ba-478a-bb37-1feb1a233460 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:03.588627 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fabc6-47ba-478a-bb37-1feb1a233460 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:03.589017 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fabc6-47ba-478a-bb37-1feb1a233460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:03.604720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:03.668172 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-b74fabc6-47ba-478a-bb37-1feb1a233460 None None] MFA Rules not processed for user `94b2d0afc3294d75897dda3dd8f78aed`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:03.669948 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-b74fabc6-47ba-478a-bb37-1feb1a233460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:03.744898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 700/1390] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Sep 25 00:48:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:48:03.753893 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a02e86-cb1f-4c96-ab14-bfa9e86c6434 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:03.755446 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-24a02e86-cb1f-4c96-ab14-bfa9e86c6434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:03.864092 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a02e86-cb1f-4c96-ab14-bfa9e86c6434 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:03.923530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:03.939921 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de839c1-ca63-4733-971f-6bbbcca07ca3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2d0afc3294d75897dda3dd8f78aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:03.940527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de839c1-ca63-4733-971f-6bbbcca07ca3 service glance] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:03.940841 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de839c1-ca63-4733-971f-6bbbcca07ca3 service glance] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:03.941114 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de839c1-ca63-4733-971f-6bbbcca07ca3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:03.942713 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-4de839c1-ca63-4733-971f-6bbbcca07ca3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:04.054684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de839c1-ca63-4733-971f-6bbbcca07ca3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:04.056152 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de839c1-ca63-4733-971f-6bbbcca07ca3 service glance] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:04.074386 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 691/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:04.709971 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576d75a-e76c-4261-aa71-46c9d66d0f07 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:04.710513 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576d75a-e76c-4261-aa71-46c9d66d0f07 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:04.710513 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576d75a-e76c-4261-aa71-46c9d66d0f07 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:04.711958 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 701/1392] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:04.717998 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88a87c-33dd-4e8e-89b6-5c5d70b5c3a0 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:04.718534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88a87c-33dd-4e8e-89b6-5c5d70b5c3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:04.718651 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88a87c-33dd-4e8e-89b6-5c5d70b5c3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:04.789079 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-bf88a87c-33dd-4e8e-89b6-5c5d70b5c3a0 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:04.790309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-bf88a87c-33dd-4e8e-89b6-5c5d70b5c3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:04.839831 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee060443-f76c-4e32-bf95-d3f88ab8af3f None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:04.840075 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:04.840210 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee060443-f76c-4e32-bf95-d3f88ab8af3f None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:04.840381 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee060443-f76c-4e32-bf95-d3f88ab8af3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:04.897932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 692/1393] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:04.910525 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-ee060443-f76c-4e32-bf95-d3f88ab8af3f None None] MFA Rules not processed for user `6c53cca11c1c45a89651026d2ac75cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:04.911745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-ee060443-f76c-4e32-bf95-d3f88ab8af3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:04.965552 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:04.998364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 702/1394] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Sep 25 00:48:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:48:05.040351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889b280-df10-45af-8155-1079aa9a7f02 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:05.040748 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889b280-df10-45af-8155-1079aa9a7f02 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:05.041094 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889b280-df10-45af-8155-1079aa9a7f02 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:05.042575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 693/1395] 10.222.0.27 () {54 vars in 943 bytes} [Sun Sep 25 00:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:05.049023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1af737-cdbc-419d-8ead-c47b0cc2961e None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:05.049309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1af737-cdbc-419d-8ead-c47b0cc2961e None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:05.049585 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1af737-cdbc-419d-8ead-c47b0cc2961e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:05.123540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-bf1af737-cdbc-419d-8ead-c47b0cc2961e None None] MFA Rules not processed for user `38f2083bb2a54a9ca22546b5e7aaf032`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:05.124693 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-bf1af737-cdbc-419d-8ead-c47b0cc2961e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:05.189766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889b280-df10-45af-8155-1079aa9a7f02 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:05.191514 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-2889b280-df10-45af-8155-1079aa9a7f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:05.235973 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 703/1396] 10.222.0.27 () {58 vars in 1040 bytes} [Sun Sep 25 00:48:05 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:05.245917 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1af737-cdbc-419d-8ead-c47b0cc2961e None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:05.256997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1af737-cdbc-419d-8ead-c47b0cc2961e None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:05.283701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:05.340355 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889b280-df10-45af-8155-1079aa9a7f02 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:05.362012 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141134c-80d3-43f5-90ed-c17c99c5fa3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f2083bb2a54a9ca22546b5e7aaf032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:05.362621 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141134c-80d3-43f5-90ed-c17c99c5fa3e service swift] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:05.362898 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141134c-80d3-43f5-90ed-c17c99c5fa3e service swift] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:05.363174 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141134c-80d3-43f5-90ed-c17c99c5fa3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:05.364846 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-5141134c-80d3-43f5-90ed-c17c99c5fa3e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:05.365555 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:05.451688 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141134c-80d3-43f5-90ed-c17c99c5fa3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:05.453362 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141134c-80d3-43f5-90ed-c17c99c5fa3e service swift] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:05.455730 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238cd35-ed68-4f18-b5d8-082875890da6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:05.456339 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238cd35-ed68-4f18-b5d8-082875890da6 service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:05.456644 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238cd35-ed68-4f18-b5d8-082875890da6 service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:05.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238cd35-ed68-4f18-b5d8-082875890da6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:05.458491 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-7238cd35-ed68-4f18-b5d8-082875890da6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:05.461750 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 704/1397] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Sep 25 00:48:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 00:48:05.566018 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238cd35-ed68-4f18-b5d8-082875890da6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:05.567629 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238cd35-ed68-4f18-b5d8-082875890da6 service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:05.588713 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 694/1398] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:07.793395 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59238c7c-b968-4944-bea2-7ef46692d1c9 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:07.794516 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59238c7c-b968-4944-bea2-7ef46692d1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:07.794516 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59238c7c-b968-4944-bea2-7ef46692d1c9 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:07.797462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 705/1399] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:48:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:07.801101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4665b5-2d21-4b58-9a57-4d95e4e61be7 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:07.801530 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4665b5-2d21-4b58-9a57-4d95e4e61be7 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:07.801643 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4665b5-2d21-4b58-9a57-4d95e4e61be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:07.840689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:07.875255 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-bb4665b5-2d21-4b58-9a57-4d95e4e61be7 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:07.876484 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-bb4665b5-2d21-4b58-9a57-4d95e4e61be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:07.983356 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 695/1400] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:08.272062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59238c7c-b968-4944-bea2-7ef46692d1c9 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:08.273633 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-59238c7c-b968-4944-bea2-7ef46692d1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:08.341180 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:08.440367 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59238c7c-b968-4944-bea2-7ef46692d1c9 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:08.566572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f9c05-86ec-4ce4-8139-c8d9b8b553b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:08.567537 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f9c05-86ec-4ce4-8139-c8d9b8b553b4 service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:08.567887 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f9c05-86ec-4ce4-8139-c8d9b8b553b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:08.568219 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f9c05-86ec-4ce4-8139-c8d9b8b553b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:08.571082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-664f9c05-86ec-4ce4-8139-c8d9b8b553b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:08.591499 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:08.672751 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f9c05-86ec-4ce4-8139-c8d9b8b553b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:08.674439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f9c05-86ec-4ce4-8139-c8d9b8b553b4 service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:08.696782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 706/1401] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:11.024048 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bda5c-3c4a-45ad-9ab9-a10fc5d9f50c None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:11.024657 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bda5c-3c4a-45ad-9ab9-a10fc5d9f50c None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:11.024657 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bda5c-3c4a-45ad-9ab9-a10fc5d9f50c None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:11.026121 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 696/1402] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:11.032156 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56f12-89ff-4af5-84f3-0f90e42795fa None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:11.032749 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56f12-89ff-4af5-84f3-0f90e42795fa None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:11.032749 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56f12-89ff-4af5-84f3-0f90e42795fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:11.102160 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-c7b56f12-89ff-4af5-84f3-0f90e42795fa None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:11.103635 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-c7b56f12-89ff-4af5-84f3-0f90e42795fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:11.203570 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:11.210174 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 707/1403] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:11.503761 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bda5c-3c4a-45ad-9ab9-a10fc5d9f50c None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:11.505495 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-f43bda5c-3c4a-45ad-9ab9-a10fc5d9f50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:11.621721 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:11.668466 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bda5c-3c4a-45ad-9ab9-a10fc5d9f50c None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:11.792222 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0a6de-4279-4f62-9c4f-189b0b94f814 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:11.793823 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0a6de-4279-4f62-9c4f-189b0b94f814 service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:11.794315 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0a6de-4279-4f62-9c4f-189b0b94f814 service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:11.794666 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0a6de-4279-4f62-9c4f-189b0b94f814 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:11.796380 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-5df0a6de-4279-4f62-9c4f-189b0b94f814 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:11.882059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:11.903443 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0a6de-4279-4f62-9c4f-189b0b94f814 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:11.908013 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0a6de-4279-4f62-9c4f-189b0b94f814 service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:11.929052 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 697/1404] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:14.158069 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d070f-9fbd-4e38-81f7-4d053b40ea7b None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:14.158883 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d070f-9fbd-4e38-81f7-4d053b40ea7b None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:14.158883 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d070f-9fbd-4e38-81f7-4d053b40ea7b None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:14.160216 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 708/1405] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:14.165470 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f35fc-7e40-4c91-9dc5-db92919915dd None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:14.165878 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f35fc-7e40-4c91-9dc5-db92919915dd None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:14.166030 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f35fc-7e40-4c91-9dc5-db92919915dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:14.236450 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-f63f35fc-7e40-4c91-9dc5-db92919915dd None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:14.237866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-f63f35fc-7e40-4c91-9dc5-db92919915dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:14.438534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 698/1406] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:14.747565 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d070f-9fbd-4e38-81f7-4d053b40ea7b None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:14.749158 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-7c1d070f-9fbd-4e38-81f7-4d053b40ea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:14.917916 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d070f-9fbd-4e38-81f7-4d053b40ea7b None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:14.996681 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:15.049559 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11f818-7cff-4912-ab35-685bda00a7e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:15.050340 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11f818-7cff-4912-ab35-685bda00a7e6 service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:15.050613 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11f818-7cff-4912-ab35-685bda00a7e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:15.050882 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11f818-7cff-4912-ab35-685bda00a7e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:15.052485 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-8d11f818-7cff-4912-ab35-685bda00a7e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:15.153662 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11f818-7cff-4912-ab35-685bda00a7e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:15.155399 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11f818-7cff-4912-ab35-685bda00a7e6 service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:15.174426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 709/1407] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:24.435796 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=79 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:25.172017 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=64 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:28.091644 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd47c04-a741-4307-8b11-588c6fc56e3e None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:28.092173 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd47c04-a741-4307-8b11-588c6fc56e3e None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:28.092173 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd47c04-a741-4307-8b11-588c6fc56e3e None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:28.093527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 699/1408] 10.222.0.27 () {54 vars in 918 bytes} [Sun Sep 25 00:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:28.098808 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254503c-012e-429f-ba65-c8c79e9c8d1c None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:28.099231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254503c-012e-429f-ba65-c8c79e9c8d1c None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:28.099337 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254503c-012e-429f-ba65-c8c79e9c8d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:28.178720 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-8254503c-012e-429f-ba65-c8c79e9c8d1c None None] MFA Rules not processed for user `bac1aba93232486eb2bd5b3200cb6fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:28.179940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-8254503c-012e-429f-ba65-c8c79e9c8d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:28.283566 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 710/1409] 10.222.0.27 () {58 vars in 1015 bytes} [Sun Sep 25 00:48:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:28.298606 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460763b-4c17-4701-ab3f-f73d366ce84d None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:28.298890 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460763b-4c17-4701-ab3f-f73d366ce84d None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:28.299162 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460763b-4c17-4701-ab3f-f73d366ce84d None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:28.300504 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 700/1410] 10.222.0.27 () {54 vars in 918 bytes} [Sun Sep 25 00:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:28.305090 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5f920-b9ad-4ec1-b924-5c844637e9d0 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:28.305374 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5f920-b9ad-4ec1-b924-5c844637e9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:28.305648 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5f920-b9ad-4ec1-b924-5c844637e9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:28.377466 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:28.380477 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-49e5f920-b9ad-4ec1-b924-5c844637e9d0 None None] MFA Rules not processed for user `d494b82a81ca42a69fe7d9efc2f2a251`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:28.382247 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-49e5f920-b9ad-4ec1-b924-5c844637e9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:28.494380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 711/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Sun Sep 25 00:48:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:31.040413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff4066-f7e8-4316-8b6e-f67eb25c2b76 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:31.040974 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff4066-f7e8-4316-8b6e-f67eb25c2b76 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:31.040974 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff4066-f7e8-4316-8b6e-f67eb25c2b76 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:31.042364 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 701/1412] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:31.048277 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8441c-f855-4ef8-9249-0069b28a31c6 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:31.048758 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8441c-f855-4ef8-9249-0069b28a31c6 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:31.048868 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8441c-f855-4ef8-9249-0069b28a31c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:31.115468 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-b5a8441c-f855-4ef8-9249-0069b28a31c6 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:31.116621 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-b5a8441c-f855-4ef8-9249-0069b28a31c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:31.169992 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:31.211202 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 712/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:31.496290 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff4066-f7e8-4316-8b6e-f67eb25c2b76 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:31.498008 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-fbff4066-f7e8-4316-8b6e-f67eb25c2b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:31.642624 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff4066-f7e8-4316-8b6e-f67eb25c2b76 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:31.713357 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:31.754582 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba9cf0-76d2-4cfc-b427-b5bc6be6dcbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:31.755108 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9cf0-76d2-4cfc-b427-b5bc6be6dcbe service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:31.755385 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9cf0-76d2-4cfc-b427-b5bc6be6dcbe service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:31.755652 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9cf0-76d2-4cfc-b427-b5bc6be6dcbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:31.757274 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-20ba9cf0-76d2-4cfc-b427-b5bc6be6dcbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:31.849575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba9cf0-76d2-4cfc-b427-b5bc6be6dcbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:31.851182 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba9cf0-76d2-4cfc-b427-b5bc6be6dcbe service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:31.868702 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 702/1414] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:32.999737 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b451be9-76d6-40fd-84a0-f2385e119887 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:33.000275 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b451be9-76d6-40fd-84a0-f2385e119887 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:33.000275 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b451be9-76d6-40fd-84a0-f2385e119887 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:33.002168 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 713/1415] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:33.008511 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94318e2-319b-47e9-b8c1-cdd71c707a51 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:33.008976 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94318e2-319b-47e9-b8c1-cdd71c707a51 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:33.009083 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94318e2-319b-47e9-b8c1-cdd71c707a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:33.083830 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-b94318e2-319b-47e9-b8c1-cdd71c707a51 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:33.084984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-b94318e2-319b-47e9-b8c1-cdd71c707a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:33.110717 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:33.179098 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 703/1416] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:33.328657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b451be9-76d6-40fd-84a0-f2385e119887 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:33.330815 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-1b451be9-76d6-40fd-84a0-f2385e119887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:33.471364 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b451be9-76d6-40fd-84a0-f2385e119887 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:33.511009 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:33.586553 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b16af2-0fa5-41dc-860c-00aa013ea1a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:33.587156 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b16af2-0fa5-41dc-860c-00aa013ea1a9 service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:33.587431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b16af2-0fa5-41dc-860c-00aa013ea1a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:33.587701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b16af2-0fa5-41dc-860c-00aa013ea1a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:33.589315 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-36b16af2-0fa5-41dc-860c-00aa013ea1a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:33.677640 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b16af2-0fa5-41dc-860c-00aa013ea1a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:33.679258 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b16af2-0fa5-41dc-860c-00aa013ea1a9 service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:33.697590 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 714/1417] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:34.827859 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61667247-194f-4139-aeae-111dc352e719 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:34.828324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61667247-194f-4139-aeae-111dc352e719 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:34.828438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61667247-194f-4139-aeae-111dc352e719 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:34.830429 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 704/1418] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:34.836695 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee41a8-14c9-41df-aef3-49b2da2be7d6 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:34.837152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee41a8-14c9-41df-aef3-49b2da2be7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:34.837266 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee41a8-14c9-41df-aef3-49b2da2be7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:34.892053 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:34.913351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-adee41a8-14c9-41df-aef3-49b2da2be7d6 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:34.914561 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-adee41a8-14c9-41df-aef3-49b2da2be7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:35.014630 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 715/1419] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:35.164082 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61667247-194f-4139-aeae-111dc352e719 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:35.165913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-61667247-194f-4139-aeae-111dc352e719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:35.310324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61667247-194f-4139-aeae-111dc352e719 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:35.322139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:35.420961 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89a30e-29e4-4019-bf40-6fe654ca2fee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:35.421482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89a30e-29e4-4019-bf40-6fe654ca2fee service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:35.421756 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89a30e-29e4-4019-bf40-6fe654ca2fee service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:35.422025 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89a30e-29e4-4019-bf40-6fe654ca2fee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:35.424224 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-6b89a30e-29e4-4019-bf40-6fe654ca2fee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:35.511090 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89a30e-29e4-4019-bf40-6fe654ca2fee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:35.512714 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89a30e-29e4-4019-bf40-6fe654ca2fee service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:35.530018 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 705/1420] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:36.650154 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71caa2-901a-4560-a9bf-e79bf72f83a3 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:36.650703 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71caa2-901a-4560-a9bf-e79bf72f83a3 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:36.650703 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71caa2-901a-4560-a9bf-e79bf72f83a3 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:36.652036 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 716/1421] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:36.658142 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cbca9-4ae4-4413-b4c8-1dd024ea1230 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:36.659125 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cbca9-4ae4-4413-b4c8-1dd024ea1230 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:36.659253 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cbca9-4ae4-4413-b4c8-1dd024ea1230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:36.678688 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:36.733789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-b11cbca9-4ae4-4413-b4c8-1dd024ea1230 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:36.734984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-b11cbca9-4ae4-4413-b4c8-1dd024ea1230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:36.830068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 706/1422] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:36.979483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71caa2-901a-4560-a9bf-e79bf72f83a3 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:36.980960 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-7d71caa2-901a-4560-a9bf-e79bf72f83a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:37.089679 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:37.125770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71caa2-901a-4560-a9bf-e79bf72f83a3 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:37.235917 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080feba2-a92c-4132-a31b-f348eb1a3b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:37.236452 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080feba2-a92c-4132-a31b-f348eb1a3b23 service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:37.237278 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080feba2-a92c-4132-a31b-f348eb1a3b23 service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:37.237556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080feba2-a92c-4132-a31b-f348eb1a3b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:37.239167 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-080feba2-a92c-4132-a31b-f348eb1a3b23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:37.314275 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:37.328228 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080feba2-a92c-4132-a31b-f348eb1a3b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:37.329855 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080feba2-a92c-4132-a31b-f348eb1a3b23 service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:37.347164 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 717/1423] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:38.455933 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e199-6f72-4b14-8001-cecacedbbdff None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:38.457058 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e199-6f72-4b14-8001-cecacedbbdff None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:38.457156 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e199-6f72-4b14-8001-cecacedbbdff None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:38.458455 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 707/1424] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:38.464907 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64cab6-7913-43f8-a6d9-fa3ff2e9f799 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:38.465344 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64cab6-7913-43f8-a6d9-fa3ff2e9f799 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:38.465604 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64cab6-7913-43f8-a6d9-fa3ff2e9f799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:38.551675 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-5a64cab6-7913-43f8-a6d9-fa3ff2e9f799 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:38.552936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-5a64cab6-7913-43f8-a6d9-fa3ff2e9f799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:38.646701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 718/1425] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:38.794371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4e199-6f72-4b14-8001-cecacedbbdff None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:38.795941 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-a2e4e199-6f72-4b14-8001-cecacedbbdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:38.880925 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:38.942181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4e199-6f72-4b14-8001-cecacedbbdff None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:39.054366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e861579-1d6c-407d-a1c2-33d0c49da84c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:39.054975 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861579-1d6c-407d-a1c2-33d0c49da84c service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:39.055257 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861579-1d6c-407d-a1c2-33d0c49da84c service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:39.055533 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861579-1d6c-407d-a1c2-33d0c49da84c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:39.057182 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-3e861579-1d6c-407d-a1c2-33d0c49da84c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:39.105929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:39.146783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e861579-1d6c-407d-a1c2-33d0c49da84c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:39.148401 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e861579-1d6c-407d-a1c2-33d0c49da84c service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:39.166559 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 708/1426] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:40.228372 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9fd19-c332-4080-ac0f-b94b1ff544d2 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:40.229030 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9fd19-c332-4080-ac0f-b94b1ff544d2 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:40.229030 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9fd19-c332-4080-ac0f-b94b1ff544d2 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:40.230311 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 719/1427] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:40.237184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984321b-e136-410f-a9bb-f79d8d4f099b None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:40.237695 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984321b-e136-410f-a9bb-f79d8d4f099b None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:40.239889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984321b-e136-410f-a9bb-f79d8d4f099b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:40.314534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-6984321b-e136-410f-a9bb-f79d8d4f099b None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:40.315759 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-6984321b-e136-410f-a9bb-f79d8d4f099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:40.410103 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 709/1428] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:40.561571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9fd19-c332-4080-ac0f-b94b1ff544d2 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:40.563162 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-88f9fd19-c332-4080-ac0f-b94b1ff544d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:40.614609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:40.712518 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9fd19-c332-4080-ac0f-b94b1ff544d2 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:40.824141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea2d2a-e7db-445d-86f0-b8e4298cd983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:40.824931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea2d2a-e7db-445d-86f0-b8e4298cd983 service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:40.825030 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea2d2a-e7db-445d-86f0-b8e4298cd983 service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:40.825226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea2d2a-e7db-445d-86f0-b8e4298cd983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:40.826808 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-70ea2d2a-e7db-445d-86f0-b8e4298cd983 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:40.834283 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:40.918258 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea2d2a-e7db-445d-86f0-b8e4298cd983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:40.919849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea2d2a-e7db-445d-86f0-b8e4298cd983 service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:40.937548 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 720/1429] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:41.998060 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c1cd6-be44-4455-82cf-bcbe2a110e2a None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:41.998499 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c1cd6-be44-4455-82cf-bcbe2a110e2a None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:41.998620 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c1cd6-be44-4455-82cf-bcbe2a110e2a None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:41.999949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 710/1430] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:42.006741 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65856c-e406-481e-8831-a775ae57bc81 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:42.007196 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65856c-e406-481e-8831-a775ae57bc81 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:42.007300 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65856c-e406-481e-8831-a775ae57bc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:42.081238 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-cd65856c-e406-481e-8831-a775ae57bc81 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:42.082367 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-cd65856c-e406-481e-8831-a775ae57bc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:42.149198 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:42.177798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 721/1431] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:42.333353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c1cd6-be44-4455-82cf-bcbe2a110e2a None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:42.334831 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-aa9c1cd6-be44-4455-82cf-bcbe2a110e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:42.352255 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:42.478551 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c1cd6-be44-4455-82cf-bcbe2a110e2a None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:42.564428 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:42.591584 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d74c-84f1-4c1f-ab11-caeb9443e46b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:42.592573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d74c-84f1-4c1f-ab11-caeb9443e46b service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:42.593105 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d74c-84f1-4c1f-ab11-caeb9443e46b service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:42.593589 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d74c-84f1-4c1f-ab11-caeb9443e46b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:42.595300 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-7c16d74c-84f1-4c1f-ab11-caeb9443e46b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:42.693374 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d74c-84f1-4c1f-ab11-caeb9443e46b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:42.695009 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d74c-84f1-4c1f-ab11-caeb9443e46b service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:42.713587 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 711/1432] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:43.750022 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70075f-d015-45c4-b838-7dd361d9c721 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:43.750634 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70075f-d015-45c4-b838-7dd361d9c721 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:43.750634 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70075f-d015-45c4-b838-7dd361d9c721 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:43.751888 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 722/1433] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:43.758326 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a726d9-f8b9-4988-86ed-87d25db0a44a None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:43.758743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a726d9-f8b9-4988-86ed-87d25db0a44a None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:43.758867 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a726d9-f8b9-4988-86ed-87d25db0a44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:43.834027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-a9a726d9-f8b9-4988-86ed-87d25db0a44a None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:43.835239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-a9a726d9-f8b9-4988-86ed-87d25db0a44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:43.877393 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:43.931568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 712/1434] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:44.089707 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70075f-d015-45c4-b838-7dd361d9c721 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:44.091141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-8a70075f-d015-45c4-b838-7dd361d9c721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:44.243440 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70075f-d015-45c4-b838-7dd361d9c721 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:44.302275 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:44.362579 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe880ab-f0d2-4754-85c3-69aa250f77ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:44.363192 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe880ab-f0d2-4754-85c3-69aa250f77ec service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:44.363472 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe880ab-f0d2-4754-85c3-69aa250f77ec service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:44.363745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe880ab-f0d2-4754-85c3-69aa250f77ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:44.365408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-2fe880ab-f0d2-4754-85c3-69aa250f77ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:44.456810 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe880ab-f0d2-4754-85c3-69aa250f77ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:44.458426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe880ab-f0d2-4754-85c3-69aa250f77ec service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:44.476629 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 723/1435] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:45.554435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cb9ad-f2be-4788-b541-0130804ad56c None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:45.555006 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cb9ad-f2be-4788-b541-0130804ad56c None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:45.555006 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cb9ad-f2be-4788-b541-0130804ad56c None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:45.556393 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 713/1436] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:45.562607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a19d-b7ba-4c81-8a25-28ce17a0fd41 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:45.563068 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a19d-b7ba-4c81-8a25-28ce17a0fd41 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:45.563177 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a19d-b7ba-4c81-8a25-28ce17a0fd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:45.637572 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-71f5a19d-b7ba-4c81-8a25-28ce17a0fd41 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:45.638806 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-71f5a19d-b7ba-4c81-8a25-28ce17a0fd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:45.640864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:45.736012 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 724/1437] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:45.888820 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cb9ad-f2be-4788-b541-0130804ad56c None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:45.890370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-8a5cb9ad-f2be-4788-b541-0130804ad56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:46.033864 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cb9ad-f2be-4788-b541-0130804ad56c None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:46.061836 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:46.147622 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c70652-08ab-46f0-a6a8-38668c00ba35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:46.148231 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c70652-08ab-46f0-a6a8-38668c00ba35 service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:46.148509 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c70652-08ab-46f0-a6a8-38668c00ba35 service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:46.148810 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c70652-08ab-46f0-a6a8-38668c00ba35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:46.150427 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-13c70652-08ab-46f0-a6a8-38668c00ba35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:46.236748 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c70652-08ab-46f0-a6a8-38668c00ba35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:46.238344 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c70652-08ab-46f0-a6a8-38668c00ba35 service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:46.256208 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 714/1438] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:48.292125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b95096-b861-435f-aedd-810f9cc20bd4 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:48.292704 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b95096-b861-435f-aedd-810f9cc20bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:48.292704 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b95096-b861-435f-aedd-810f9cc20bd4 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:48.294038 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 725/1439] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:48.299693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545221d-4147-46f0-acf0-c560e95a7441 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:48.300122 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545221d-4147-46f0-acf0-c560e95a7441 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:48.300249 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545221d-4147-46f0-acf0-c560e95a7441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:48.341375 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:48.367005 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-3545221d-4147-46f0-acf0-c560e95a7441 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:48.368232 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-3545221d-4147-46f0-acf0-c560e95a7441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:48.462817 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 715/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:48.747970 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b95096-b861-435f-aedd-810f9cc20bd4 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:48.749610 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-59b95096-b861-435f-aedd-810f9cc20bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:48.850674 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b95096-b861-435f-aedd-810f9cc20bd4 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:48.883005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:48.923909 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a75d0-2700-42df-b0f3-240e0ab42d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:48.924540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a75d0-2700-42df-b0f3-240e0ab42d78 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:48.924845 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a75d0-2700-42df-b0f3-240e0ab42d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:48.925113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a75d0-2700-42df-b0f3-240e0ab42d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:48.926857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-7b3a75d0-2700-42df-b0f3-240e0ab42d78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:49.037459 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a75d0-2700-42df-b0f3-240e0ab42d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:49.039348 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a75d0-2700-42df-b0f3-240e0ab42d78 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:49.057889 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 726/1441] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:51.364107 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68656a66-008d-4597-aae8-404a3ed10976 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:51.364738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68656a66-008d-4597-aae8-404a3ed10976 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:51.364738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68656a66-008d-4597-aae8-404a3ed10976 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:51.366085 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 716/1442] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:51.371939 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a983df-91e6-4325-bc91-4656dc71a689 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:51.372369 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a983df-91e6-4325-bc91-4656dc71a689 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:51.372490 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a983df-91e6-4325-bc91-4656dc71a689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:51.437064 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-62a983df-91e6-4325-bc91-4656dc71a689 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:51.438249 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-62a983df-91e6-4325-bc91-4656dc71a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:51.451092 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:51.533408 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 727/1443] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:51.822920 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68656a66-008d-4597-aae8-404a3ed10976 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:51.824946 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-68656a66-008d-4597-aae8-404a3ed10976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:51.926362 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68656a66-008d-4597-aae8-404a3ed10976 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:51.939443 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:51.998645 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a2ae0-e3f1-4d9e-85ba-0ba135981d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:51.999244 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a2ae0-e3f1-4d9e-85ba-0ba135981d5e service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:51.999517 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a2ae0-e3f1-4d9e-85ba-0ba135981d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:51.999781 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a2ae0-e3f1-4d9e-85ba-0ba135981d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:52.001411 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-1c0a2ae0-e3f1-4d9e-85ba-0ba135981d5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:52.231478 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a2ae0-e3f1-4d9e-85ba-0ba135981d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:52.232951 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a2ae0-e3f1-4d9e-85ba-0ba135981d5e service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:52.250422 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 717/1444] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:54.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76204dc-da42-4d51-a584-814943032bcf None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:54.712486 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76204dc-da42-4d51-a584-814943032bcf None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:54.712486 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76204dc-da42-4d51-a584-814943032bcf None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:54.714429 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 728/1445] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:54.719782 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cdaa4-06a8-4e4c-9694-e8731fdca118 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:54.720181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cdaa4-06a8-4e4c-9694-e8731fdca118 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:54.720336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cdaa4-06a8-4e4c-9694-e8731fdca118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:54.767292 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:54.786784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-bf5cdaa4-06a8-4e4c-9694-e8731fdca118 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:54.788019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-bf5cdaa4-06a8-4e4c-9694-e8731fdca118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:54.883305 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 718/1446] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:55.168985 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76204dc-da42-4d51-a584-814943032bcf None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:55.170515 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-b76204dc-da42-4d51-a584-814943032bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:55.272443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76204dc-da42-4d51-a584-814943032bcf None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:55.312560 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:55.346518 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfe75e-f0d0-4543-badc-1e86c0162df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:55.347127 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfe75e-f0d0-4543-badc-1e86c0162df4 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:55.347415 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfe75e-f0d0-4543-badc-1e86c0162df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:55.347685 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfe75e-f0d0-4543-badc-1e86c0162df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:55.349366 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-e1dfe75e-f0d0-4543-badc-1e86c0162df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:55.459912 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfe75e-f0d0-4543-badc-1e86c0162df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:55.461291 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfe75e-f0d0-4543-badc-1e86c0162df4 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:55.479351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 729/1447] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:48:57.759129 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2be832-28ec-480d-9f30-f452c8a1d51a None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:57.759667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2be832-28ec-480d-9f30-f452c8a1d51a None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:57.759667 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2be832-28ec-480d-9f30-f452c8a1d51a None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:57.761578 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 719/1448] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:48:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:57.766868 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d891d-399b-4dc8-a84b-c90624a1d08f None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:57.767290 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d891d-399b-4dc8-a84b-c90624a1d08f None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:57.767407 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d891d-399b-4dc8-a84b-c90624a1d08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:57.835668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-102d891d-399b-4dc8-a84b-c90624a1d08f None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:57.836929 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-102d891d-399b-4dc8-a84b-c90624a1d08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:57.857570 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:57.932821 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 730/1449] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:48:58.223025 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2be832-28ec-480d-9f30-f452c8a1d51a None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:58.224607 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-6c2be832-28ec-480d-9f30-f452c8a1d51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:58.328107 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2be832-28ec-480d-9f30-f452c8a1d51a None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:58.348103 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:58.403758 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad439395-5299-4b41-8b37-f903f67ba5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:58.404360 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad439395-5299-4b41-8b37-f903f67ba5ba service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:58.404661 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad439395-5299-4b41-8b37-f903f67ba5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:58.404936 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad439395-5299-4b41-8b37-f903f67ba5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:58.406534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-ad439395-5299-4b41-8b37-f903f67ba5ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:58.513364 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad439395-5299-4b41-8b37-f903f67ba5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:58.514714 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad439395-5299-4b41-8b37-f903f67ba5ba service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:58.531928 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 720/1450] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:49:00.834825 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26f4eb-2b50-46a8-9528-e319fe845b48 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:00.835279 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26f4eb-2b50-46a8-9528-e319fe845b48 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:00.835398 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26f4eb-2b50-46a8-9528-e319fe845b48 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:00.836743 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 731/1451] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:00.842510 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c416e18-e1f6-4e8f-a406-b8c912f8e4ba None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:00.842907 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c416e18-e1f6-4e8f-a406-b8c912f8e4ba None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:00.843066 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c416e18-e1f6-4e8f-a406-b8c912f8e4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:00.906097 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:00.908839 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-1c416e18-e1f6-4e8f-a406-b8c912f8e4ba None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:00.910537 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-1c416e18-e1f6-4e8f-a406-b8c912f8e4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:01.004573 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 721/1452] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:49:01.285886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26f4eb-2b50-46a8-9528-e319fe845b48 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:01.287464 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-cf26f4eb-2b50-46a8-9528-e319fe845b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:01.389683 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26f4eb-2b50-46a8-9528-e319fe845b48 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:01.437478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:01.462073 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cef6a-1ea8-492e-bee2-b1e41255ed42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:01.462667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cef6a-1ea8-492e-bee2-b1e41255ed42 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:01.462942 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cef6a-1ea8-492e-bee2-b1e41255ed42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:01.463210 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cef6a-1ea8-492e-bee2-b1e41255ed42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:01.464843 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-da6cef6a-1ea8-492e-bee2-b1e41255ed42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:01.572056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cef6a-1ea8-492e-bee2-b1e41255ed42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:01.573452 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cef6a-1ea8-492e-bee2-b1e41255ed42 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:01.591045 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 732/1453] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:49:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:49:03.776095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea572e77-4d7e-4a3d-8a03-eda02b3b6547 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:03.776659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea572e77-4d7e-4a3d-8a03-eda02b3b6547 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:03.776659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea572e77-4d7e-4a3d-8a03-eda02b3b6547 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:03.777997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 722/1454] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:03.783778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17476c-de8f-43a8-b05f-895c6e54aaec None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:03.784182 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17476c-de8f-43a8-b05f-895c6e54aaec None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:03.784337 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17476c-de8f-43a8-b05f-895c6e54aaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:03.851642 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-cc17476c-de8f-43a8-b05f-895c6e54aaec None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:03.852893 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-cc17476c-de8f-43a8-b05f-895c6e54aaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:03.880627 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:03.949862 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 733/1455] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:49:04.235013 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea572e77-4d7e-4a3d-8a03-eda02b3b6547 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:04.236562 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-ea572e77-4d7e-4a3d-8a03-eda02b3b6547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:04.337422 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea572e77-4d7e-4a3d-8a03-eda02b3b6547 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:04.369684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:04.417082 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece6dfd-0bce-4e40-aee8-f5f196b8059d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:04.417682 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece6dfd-0bce-4e40-aee8-f5f196b8059d service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:04.417958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece6dfd-0bce-4e40-aee8-f5f196b8059d service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:04.418227 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece6dfd-0bce-4e40-aee8-f5f196b8059d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:04.419812 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-6ece6dfd-0bce-4e40-aee8-f5f196b8059d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:04.528035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece6dfd-0bce-4e40-aee8-f5f196b8059d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:04.529427 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece6dfd-0bce-4e40-aee8-f5f196b8059d service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:04.547503 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 723/1456] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:49:06.761456 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41505547-8ecd-4b15-9d88-6b124aa63525 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:06.762002 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41505547-8ecd-4b15-9d88-6b124aa63525 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:06.762002 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41505547-8ecd-4b15-9d88-6b124aa63525 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:06.763355 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 734/1457] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:06.769263 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d814a78-35a4-4754-a3ef-b60a6a946f1f None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:06.769671 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d814a78-35a4-4754-a3ef-b60a6a946f1f None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:06.769809 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d814a78-35a4-4754-a3ef-b60a6a946f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:06.834651 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-2d814a78-35a4-4754-a3ef-b60a6a946f1f None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:06.835858 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-2d814a78-35a4-4754-a3ef-b60a6a946f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:06.844600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:06.929818 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 724/1458] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:49:07.228913 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af5734-2812-4cd9-b569-66a51b1d46cd None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:07.229199 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af5734-2812-4cd9-b569-66a51b1d46cd None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:07.229478 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af5734-2812-4cd9-b569-66a51b1d46cd None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:07.230878 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 735/1459] 10.222.0.27 () {54 vars in 964 bytes} [Sun Sep 25 00:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:07.237382 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ddbfc-c59d-4f78-bc31-341f3061776a None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:07.237665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ddbfc-c59d-4f78-bc31-341f3061776a None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:07.237938 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ddbfc-c59d-4f78-bc31-341f3061776a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:07.312402 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-632ddbfc-c59d-4f78-bc31-341f3061776a None None] MFA Rules not processed for user `42a2f85512e648698fdc7ab7cac75752`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:07.313354 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-632ddbfc-c59d-4f78-bc31-341f3061776a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:07.386958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 725/1460] 10.222.0.27 () {58 vars in 1061 bytes} [Sun Sep 25 00:49:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:49:07.395965 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af5734-2812-4cd9-b569-66a51b1d46cd None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:07.397527 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-31af5734-2812-4cd9-b569-66a51b1d46cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:07.506293 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af5734-2812-4cd9-b569-66a51b1d46cd None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:07.562573 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:07.581417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6870d-ae9d-4b0d-b66a-222acf25f063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:07.582020 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6870d-ae9d-4b0d-b66a-222acf25f063 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:07.582302 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6870d-ae9d-4b0d-b66a-222acf25f063 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:07.582577 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6870d-ae9d-4b0d-b66a-222acf25f063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:07.584174 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-9ac6870d-ae9d-4b0d-b66a-222acf25f063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:07.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6870d-ae9d-4b0d-b66a-222acf25f063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:07.695296 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6870d-ae9d-4b0d-b66a-222acf25f063 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:07.713833 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 736/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:49:10.281613 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae22d4-30e5-496c-ae7e-b7a8dff4a15f None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:10.282181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae22d4-30e5-496c-ae7e-b7a8dff4a15f None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:10.282181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae22d4-30e5-496c-ae7e-b7a8dff4a15f None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:10.283734 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:10.289154 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a553c-bbda-4c26-b020-57f8eda47dd5 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:10.289593 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a553c-bbda-4c26-b020-57f8eda47dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:10.289722 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a553c-bbda-4c26-b020-57f8eda47dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:10.357058 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-d06a553c-bbda-4c26-b020-57f8eda47dd5 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:10.358380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-d06a553c-bbda-4c26-b020-57f8eda47dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:10.397976 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:10.456945 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:49:10.742282 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae22d4-30e5-496c-ae7e-b7a8dff4a15f None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:10.743899 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-40ae22d4-30e5-496c-ae7e-b7a8dff4a15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:10.749635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:10.849856 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae22d4-30e5-496c-ae7e-b7a8dff4a15f None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:10.922074 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b6156-0ff2-4a57-96ab-3eff65ca33b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:10.922675 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b6156-0ff2-4a57-96ab-3eff65ca33b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:10.922951 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b6156-0ff2-4a57-96ab-3eff65ca33b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:10.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b6156-0ff2-4a57-96ab-3eff65ca33b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:10.924837 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-8e2b6156-0ff2-4a57-96ab-3eff65ca33b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:10.981851 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:11.035324 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b6156-0ff2-4a57-96ab-3eff65ca33b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:11.036792 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b6156-0ff2-4a57-96ab-3eff65ca33b8 service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:11.057040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 727/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:49:13.200829 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fc1ec-ee7d-4c53-b715-cd70066593e3 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:13.201403 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fc1ec-ee7d-4c53-b715-cd70066593e3 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:13.201403 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fc1ec-ee7d-4c53-b715-cd70066593e3 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:13.202745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:13.208124 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd043b-1e4f-4a8b-8359-0468ca0a6655 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:13.208613 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd043b-1e4f-4a8b-8359-0468ca0a6655 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:13.208726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd043b-1e4f-4a8b-8359-0468ca0a6655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:13.272440 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-c6cd043b-1e4f-4a8b-8359-0468ca0a6655 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:13.273654 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-c6cd043b-1e4f-4a8b-8359-0468ca0a6655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:13.367120 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:49:13.655834 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fc1ec-ee7d-4c53-b715-cd70066593e3 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:13.657983 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-844fc1ec-ee7d-4c53-b715-cd70066593e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:13.760441 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fc1ec-ee7d-4c53-b715-cd70066593e3 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:13.826609 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:13.833894 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9ab99-62f7-431c-a570-e28992b3b109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:13.834502 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ab99-62f7-431c-a570-e28992b3b109 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:13.834782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ab99-62f7-431c-a570-e28992b3b109 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:13.835054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ab99-62f7-431c-a570-e28992b3b109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:13.836702 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-20b9ab99-62f7-431c-a570-e28992b3b109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:13.944788 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9ab99-62f7-431c-a570-e28992b3b109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:13.946200 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9ab99-62f7-431c-a570-e28992b3b109 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:13.967161 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 739/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:49:16.141526 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156afa29-37e7-4c01-bf2c-3d5cf2f85236 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:16.148270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156afa29-37e7-4c01-bf2c-3d5cf2f85236 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:16.148270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156afa29-37e7-4c01-bf2c-3d5cf2f85236 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:16.148270 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:16.150316 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e888eec-d25f-45b3-8ace-2354d575a3db None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:16.150316 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e888eec-d25f-45b3-8ace-2354d575a3db None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:16.150316 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e888eec-d25f-45b3-8ace-2354d575a3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:16.214484 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-3e888eec-d25f-45b3-8ace-2354d575a3db None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:16.215696 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-3e888eec-d25f-45b3-8ace-2354d575a3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:16.263191 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:16.310787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:49:16.591655 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156afa29-37e7-4c01-bf2c-3d5cf2f85236 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:16.593234 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-156afa29-37e7-4c01-bf2c-3d5cf2f85236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:16.607035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:16.695945 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156afa29-37e7-4c01-bf2c-3d5cf2f85236 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:16.768683 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422ddb4-de6e-4c4a-8c93-4974349bbb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:16.769293 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ddb4-de6e-4c4a-8c93-4974349bbb57 service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:16.769569 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ddb4-de6e-4c4a-8c93-4974349bbb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:16.769839 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ddb4-de6e-4c4a-8c93-4974349bbb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:16.771457 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-4422ddb4-de6e-4c4a-8c93-4974349bbb57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:16.838808 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:16.880558 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422ddb4-de6e-4c4a-8c93-4974349bbb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:16.882012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422ddb4-de6e-4c4a-8c93-4974349bbb57 service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:16.899265 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 730/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:49:26.309340 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=22 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:26.897068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=25 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:36.890945 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159ea7a-5008-4d9a-8fc2-d4ffd8847b85 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:36.891439 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159ea7a-5008-4d9a-8fc2-d4ffd8847b85 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:36.891551 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159ea7a-5008-4d9a-8fc2-d4ffd8847b85 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:36.892871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 741/1471] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:36.898229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727a6e8-1f75-4d04-8a5e-c070632fb75f None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:36.898658 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727a6e8-1f75-4d04-8a5e-c070632fb75f None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:36.898769 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727a6e8-1f75-4d04-8a5e-c070632fb75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:36.963754 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-2727a6e8-1f75-4d04-8a5e-c070632fb75f None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:36.965007 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-2727a6e8-1f75-4d04-8a5e-c070632fb75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:37.059055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 731/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:49:37.356246 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b3f7-91b2-4b70-bd67-6c5c18636bef None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:37.356533 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b3f7-91b2-4b70-bd67-6c5c18636bef None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:37.356837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b3f7-91b2-4b70-bd67-6c5c18636bef None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:37.358173 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 742/1473] 10.222.0.27 () {54 vars in 962 bytes} [Sun Sep 25 00:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:37.363231 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1448c5a-df44-4020-899e-5a81a4d302da None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:37.363521 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1448c5a-df44-4020-899e-5a81a4d302da None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:37.363799 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1448c5a-df44-4020-899e-5a81a4d302da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:37.439263 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-e1448c5a-df44-4020-899e-5a81a4d302da None None] MFA Rules not processed for user `94b2d0afc3294d75897dda3dd8f78aed`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:37.440490 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-e1448c5a-df44-4020-899e-5a81a4d302da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:37.461941 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:37.518784 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 732/1474] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Sep 25 00:49:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:49:37.527356 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02b3f7-91b2-4b70-bd67-6c5c18636bef None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:37.528940 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-3d02b3f7-91b2-4b70-bd67-6c5c18636bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:37.631005 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02b3f7-91b2-4b70-bd67-6c5c18636bef None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:37.702220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56b89a-aaa1-4682-b693-50428ddb16bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2d0afc3294d75897dda3dd8f78aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:37.702817 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56b89a-aaa1-4682-b693-50428ddb16bd service glance] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:37.703092 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56b89a-aaa1-4682-b693-50428ddb16bd service glance] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:37.703357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56b89a-aaa1-4682-b693-50428ddb16bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:37.704969 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-4a56b89a-aaa1-4682-b693-50428ddb16bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:37.759859 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:37.815532 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56b89a-aaa1-4682-b693-50428ddb16bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:37.817032 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56b89a-aaa1-4682-b693-50428ddb16bd service glance] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:37.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 743/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:49:40.064969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac65353-0ef7-4a41-927f-ccb119b245c4 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:40.065533 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac65353-0ef7-4a41-927f-ccb119b245c4 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:40.065533 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac65353-0ef7-4a41-927f-ccb119b245c4 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:40.066887 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 733/1476] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:40.072222 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f90cab-1a1d-4a70-8c74-cde04e96ab17 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:40.072642 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f90cab-1a1d-4a70-8c74-cde04e96ab17 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:40.072883 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f90cab-1a1d-4a70-8c74-cde04e96ab17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:40.139014 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-33f90cab-1a1d-4a70-8c74-cde04e96ab17 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:40.140257 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-33f90cab-1a1d-4a70-8c74-cde04e96ab17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:40.235872 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 744/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:49:40.507312 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac65353-0ef7-4a41-927f-ccb119b245c4 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:40.509807 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-6ac65353-0ef7-4a41-927f-ccb119b245c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:40.631498 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac65353-0ef7-4a41-927f-ccb119b245c4 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:40.679293 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:40.723136 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404dedd-876a-4ef2-b67d-00ac64c4d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:40.723738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dedd-876a-4ef2-b67d-00ac64c4d8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:40.724015 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dedd-876a-4ef2-b67d-00ac64c4d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:40.724282 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dedd-876a-4ef2-b67d-00ac64c4d8e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:40.724942 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404dedd-876a-4ef2-b67d-00ac64c4d8e7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:40.726690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: WARNING py.warnings [None req-1404dedd-876a-4ef2-b67d-00ac64c4d8e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:49:40.726690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: warnings.warn(msg) Sep 25 00:49:40.726690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: Sep 25 00:49:40.727828 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404dedd-876a-4ef2-b67d-00ac64c4d8e7 admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:40.746848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 734/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Sep 25 00:49:40 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:49:42.925496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc03c0-7a58-4805-ad82-7f6358a15d6a None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:42.926078 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc03c0-7a58-4805-ad82-7f6358a15d6a None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:42.926078 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc03c0-7a58-4805-ad82-7f6358a15d6a None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:42.927362 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 745/1479] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:42.932718 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8500600-3570-4cdf-94fe-f50d4aab9a49 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:42.933133 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8500600-3570-4cdf-94fe-f50d4aab9a49 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:42.933271 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8500600-3570-4cdf-94fe-f50d4aab9a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:42.998496 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-e8500600-3570-4cdf-94fe-f50d4aab9a49 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:42.999719 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-e8500600-3570-4cdf-94fe-f50d4aab9a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:43.094892 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 735/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:49:43.385718 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc03c0-7a58-4805-ad82-7f6358a15d6a None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:43.387231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-16fc03c0-7a58-4805-ad82-7f6358a15d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:43.396892 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:43.532414 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc03c0-7a58-4805-ad82-7f6358a15d6a None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:43.611054 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:43.643828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abe208-fc65-4e42-8bd6-6738b411978b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:43.644444 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abe208-fc65-4e42-8bd6-6738b411978b service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:43.644751 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abe208-fc65-4e42-8bd6-6738b411978b service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:43.645024 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abe208-fc65-4e42-8bd6-6738b411978b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:43.646618 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-c2abe208-fc65-4e42-8bd6-6738b411978b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:43.733350 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abe208-fc65-4e42-8bd6-6738b411978b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:43.734974 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abe208-fc65-4e42-8bd6-6738b411978b service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:43.752797 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 746/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:49:46.095401 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf5ce2-7e09-4fcd-8a5f-269775adb280 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:46.095929 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf5ce2-7e09-4fcd-8a5f-269775adb280 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:46.096045 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf5ce2-7e09-4fcd-8a5f-269775adb280 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:46.097409 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 736/1482] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:46.103563 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc545d0-7ec5-4e08-862f-ec6ae34683cd None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:46.104047 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc545d0-7ec5-4e08-862f-ec6ae34683cd None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:46.104656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc545d0-7ec5-4e08-862f-ec6ae34683cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:46.170829 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-7bc545d0-7ec5-4e08-862f-ec6ae34683cd None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:46.172028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-7bc545d0-7ec5-4e08-862f-ec6ae34683cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:46.221014 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:46.386756 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 747/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:49:46.675613 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf5ce2-7e09-4fcd-8a5f-269775adb280 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:46.677197 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-1adf5ce2-7e09-4fcd-8a5f-269775adb280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:46.701206 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:46.780643 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf5ce2-7e09-4fcd-8a5f-269775adb280 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:46.853782 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792965f1-1e7b-4df8-a56a-d9cc49ec80c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:46.854392 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792965f1-1e7b-4df8-a56a-d9cc49ec80c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:46.854674 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792965f1-1e7b-4df8-a56a-d9cc49ec80c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:46.854947 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792965f1-1e7b-4df8-a56a-d9cc49ec80c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:46.856684 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-792965f1-1e7b-4df8-a56a-d9cc49ec80c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:46.929440 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:46.965012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792965f1-1e7b-4df8-a56a-d9cc49ec80c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:46.966444 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792965f1-1e7b-4df8-a56a-d9cc49ec80c0 service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:46.983932 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 737/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:49:49.167664 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc32f65-aee9-4606-a172-dd2581f5677e None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:49.168214 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc32f65-aee9-4606-a172-dd2581f5677e None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:49.168214 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc32f65-aee9-4606-a172-dd2581f5677e None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:49.169599 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 748/1485] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:49:49.174843 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984b4a2-146e-4220-a56a-3dd2e98c370a None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:49.175317 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984b4a2-146e-4220-a56a-3dd2e98c370a None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:49.175434 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984b4a2-146e-4220-a56a-3dd2e98c370a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:49.239404 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-2984b4a2-146e-4220-a56a-3dd2e98c370a None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:49.240628 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-2984b4a2-146e-4220-a56a-3dd2e98c370a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:49.335098 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 738/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:49:49.624397 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc32f65-aee9-4606-a172-dd2581f5677e None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:49.625936 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-3bc32f65-aee9-4606-a172-dd2581f5677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:49.725425 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc32f65-aee9-4606-a172-dd2581f5677e None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:49.795174 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:49.796653 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0120d-11c8-4f64-87d6-2aa594f030ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:49.797341 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0120d-11c8-4f64-87d6-2aa594f030ae service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:49.797836 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0120d-11c8-4f64-87d6-2aa594f030ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:49.798290 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0120d-11c8-4f64-87d6-2aa594f030ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:49.800042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-2db0120d-11c8-4f64-87d6-2aa594f030ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:49.906924 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0120d-11c8-4f64-87d6-2aa594f030ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:49.908373 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0120d-11c8-4f64-87d6-2aa594f030ae service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:49.926286 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 749/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:49:52.251235 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82a91d-3b5c-4956-bbd2-7f140a59f68b None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:52.251813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82a91d-3b5c-4956-bbd2-7f140a59f68b None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:52.251813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82a91d-3b5c-4956-bbd2-7f140a59f68b None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:52.253168 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 739/1488] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:52.258551 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b917589-b5c2-4dff-bb84-62656ca3f776 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:52.258995 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b917589-b5c2-4dff-bb84-62656ca3f776 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:52.259105 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b917589-b5c2-4dff-bb84-62656ca3f776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:52.324790 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-2b917589-b5c2-4dff-bb84-62656ca3f776 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:52.326169 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-2b917589-b5c2-4dff-bb84-62656ca3f776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:52.377626 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:52.421819 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 750/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:49:52.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82a91d-3b5c-4956-bbd2-7f140a59f68b None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:52.710127 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-2c82a91d-3b5c-4956-bbd2-7f140a59f68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:52.746781 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:52.813655 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82a91d-3b5c-4956-bbd2-7f140a59f68b None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:52.888358 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dc16e-82ad-49ce-94a4-48b67d90a49f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:52.888992 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc16e-82ad-49ce-94a4-48b67d90a49f service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:52.889269 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc16e-82ad-49ce-94a4-48b67d90a49f service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:52.889546 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc16e-82ad-49ce-94a4-48b67d90a49f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:52.891125 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-040dc16e-82ad-49ce-94a4-48b67d90a49f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:52.969184 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:52.997035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dc16e-82ad-49ce-94a4-48b67d90a49f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:52.998465 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dc16e-82ad-49ce-94a4-48b67d90a49f service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:53.016193 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 740/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:49:55.415218 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c2ff3-040d-4931-a900-87c70bf06ed1 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:55.415787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c2ff3-040d-4931-a900-87c70bf06ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:55.415787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c2ff3-040d-4931-a900-87c70bf06ed1 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:55.417208 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 751/1491] 10.222.0.27 () {54 vars in 927 bytes} [Sun Sep 25 00:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:55.422335 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a12e8e-938b-4d5b-b989-a52546decebf None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:55.422765 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a12e8e-938b-4d5b-b989-a52546decebf None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:55.422874 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a12e8e-938b-4d5b-b989-a52546decebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:55.487755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-e8a12e8e-938b-4d5b-b989-a52546decebf None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:55.488987 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-e8a12e8e-938b-4d5b-b989-a52546decebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:55.587239 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 741/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Sep 25 00:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:49:55.874817 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c2ff3-040d-4931-a900-87c70bf06ed1 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:55.876380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-2d8c2ff3-040d-4931-a900-87c70bf06ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:55.979066 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c2ff3-040d-4931-a900-87c70bf06ed1 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:56.050457 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2385e35-361c-4373-bb95-68b59f66a498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:56.051056 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2385e35-361c-4373-bb95-68b59f66a498 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:56.051327 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2385e35-361c-4373-bb95-68b59f66a498 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:56.051595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2385e35-361c-4373-bb95-68b59f66a498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:56.053212 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-e2385e35-361c-4373-bb95-68b59f66a498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:56.061451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:56.165488 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2385e35-361c-4373-bb95-68b59f66a498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:56.166937 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2385e35-361c-4373-bb95-68b59f66a498 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:56.185801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 752/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:50:05.585663 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=82 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:06.182827 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=50 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:15.593560 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccfd5e-d60c-46d0-848c-6cefd823012c None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:15.594177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccfd5e-d60c-46d0-848c-6cefd823012c None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:15.594177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccfd5e-d60c-46d0-848c-6cefd823012c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:15.669125 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-57ccfd5e-d60c-46d0-848c-6cefd823012c None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:15.670346 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-57ccfd5e-d60c-46d0-848c-6cefd823012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:15.764510 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 742/1494] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:15.772349 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769096f8-3c7c-43f0-812d-e4e1ccee5fe5 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:15.772892 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769096f8-3c7c-43f0-812d-e4e1ccee5fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:15.773001 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769096f8-3c7c-43f0-812d-e4e1ccee5fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:15.847581 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-769096f8-3c7c-43f0-812d-e4e1ccee5fe5 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:15.848760 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-769096f8-3c7c-43f0-812d-e4e1ccee5fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:15.943209 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 753/1495] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:15.947825 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccfd5e-d60c-46d0-848c-6cefd823012c None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:15.949058 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-57ccfd5e-d60c-46d0-848c-6cefd823012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:15.960437 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccfd5e-d60c-46d0-848c-6cefd823012c None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:16.021631 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:16.054464 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3a3e5-fc56-4456-93f0-e285df4bbc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:16.055719 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3a3e5-fc56-4456-93f0-e285df4bbc24 admin admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:16.056001 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3a3e5-fc56-4456-93f0-e285df4bbc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:16.056271 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3a3e5-fc56-4456-93f0-e285df4bbc24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:16.056946 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3a3e5-fc56-4456-93f0-e285df4bbc24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:51:16.057250 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3a3e5-fc56-4456-93f0-e285df4bbc24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:16.058253 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: WARNING py.warnings [None req-00b3a3e5-fc56-4456-93f0-e285df4bbc24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:51:16.058253 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: warnings.warn(msg) Sep 25 00:51:16.058253 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: Sep 25 00:51:16.059140 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3a3e5-fc56-4456-93f0-e285df4bbc24 admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:16.070152 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 743/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Sep 25 00:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:51:16.078592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769096f8-3c7c-43f0-812d-e4e1ccee5fe5 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:16.088496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769096f8-3c7c-43f0-812d-e4e1ccee5fe5 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:16.146668 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:16.180110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52342d2-597e-4f0d-a7c8-cd2c4b9d3368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:16.180733 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52342d2-597e-4f0d-a7c8-cd2c4b9d3368 admin admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:16.181010 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52342d2-597e-4f0d-a7c8-cd2c4b9d3368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:16.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52342d2-597e-4f0d-a7c8-cd2c4b9d3368 admin admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:16.181914 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52342d2-597e-4f0d-a7c8-cd2c4b9d3368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:16.183693 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: WARNING py.warnings [None req-d52342d2-597e-4f0d-a7c8-cd2c4b9d3368 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:51:16.183693 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: warnings.warn(msg) Sep 25 00:51:16.183693 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: Sep 25 00:51:16.184896 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52342d2-597e-4f0d-a7c8-cd2c4b9d3368 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:16.239796 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 754/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Sep 25 00:51:16 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:51:16.244061 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3a3e5-fc56-4456-93f0-e285df4bbc24 admin admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:16.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-00b3a3e5-fc56-4456-93f0-e285df4bbc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:16.278641 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3a3e5-fc56-4456-93f0-e285df4bbc24 admin admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:16.370862 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfab73-0529-468e-9912-9cb6e3ded0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:16.371464 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfab73-0529-468e-9912-9cb6e3ded0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:16.371742 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfab73-0529-468e-9912-9cb6e3ded0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:16.372014 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfab73-0529-468e-9912-9cb6e3ded0b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:16.372660 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfab73-0529-468e-9912-9cb6e3ded0b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:16.373665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: WARNING py.warnings [None req-85dfab73-0529-468e-9912-9cb6e3ded0b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:51:16.373665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: warnings.warn(msg) Sep 25 00:51:16.373665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: Sep 25 00:51:16.374869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfab73-0529-468e-9912-9cb6e3ded0b1 admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:16.416967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 744/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Sep 25 00:51:16 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:51:16.421230 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52342d2-597e-4f0d-a7c8-cd2c4b9d3368 admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:16.422724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-d52342d2-597e-4f0d-a7c8-cd2c4b9d3368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:16.487995 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52342d2-597e-4f0d-a7c8-cd2c4b9d3368 admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:16.568984 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:16.580725 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6613035-5dbc-4a9c-8bc5-b6aaaea26eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:16.581327 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6613035-5dbc-4a9c-8bc5-b6aaaea26eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:16.581600 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6613035-5dbc-4a9c-8bc5-b6aaaea26eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:16.581866 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6613035-5dbc-4a9c-8bc5-b6aaaea26eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:16.582509 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6613035-5dbc-4a9c-8bc5-b6aaaea26eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:16.583511 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: WARNING py.warnings [None req-f6613035-5dbc-4a9c-8bc5-b6aaaea26eb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:51:16.583511 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: warnings.warn(msg) Sep 25 00:51:16.583511 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: Sep 25 00:51:16.584390 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6613035-5dbc-4a9c-8bc5-b6aaaea26eb7 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:16.597204 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 755/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Sep 25 00:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:51:16.601370 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfab73-0529-468e-9912-9cb6e3ded0b1 admin admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:16.603098 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-85dfab73-0529-468e-9912-9cb6e3ded0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:16.614453 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfab73-0529-468e-9912-9cb6e3ded0b1 admin admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:16.639755 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:16.708983 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c3530-2cd5-4aa0-aa74-84db31c6e679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:16.709523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c3530-2cd5-4aa0-aa74-84db31c6e679 admin admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:16.709799 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c3530-2cd5-4aa0-aa74-84db31c6e679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:16.710071 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c3530-2cd5-4aa0-aa74-84db31c6e679 admin admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:16.710705 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c3530-2cd5-4aa0-aa74-84db31c6e679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:16.712257 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: WARNING py.warnings [None req-294c3530-2cd5-4aa0-aa74-84db31c6e679 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:51:16.712257 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: warnings.warn(msg) Sep 25 00:51:16.712257 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: Sep 25 00:51:16.713214 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c3530-2cd5-4aa0-aa74-84db31c6e679 admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:16.725602 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 745/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Sep 25 00:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:51:16.729756 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6613035-5dbc-4a9c-8bc5-b6aaaea26eb7 admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:16.731276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-f6613035-5dbc-4a9c-8bc5-b6aaaea26eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:16.764062 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6613035-5dbc-4a9c-8bc5-b6aaaea26eb7 admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:16.856538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27222047-f6bb-4303-85db-be113972492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:16.857219 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27222047-f6bb-4303-85db-be113972492f admin admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:16.857496 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27222047-f6bb-4303-85db-be113972492f admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:16.857769 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27222047-f6bb-4303-85db-be113972492f admin admin] PATH_INFO: `/v3/projects/b5be34442f48425ba00380a0f37a78a6/users/944a038f2bb94068887e0a8fae11041c/roles/eab9c0818aa3414eb3a1a155830ad262` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:16.881999 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27222047-f6bb-4303-85db-be113972492f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5be34442f48425ba00380a0f37a78a6, user_id=944a038f2bb94068887e0a8fae11041c, role_id=eab9c0818aa3414eb3a1a155830ad262)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:16.883658 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: WARNING py.warnings [None req-27222047-f6bb-4303-85db-be113972492f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:51:16.883658 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: warnings.warn(msg) Sep 25 00:51:16.883658 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: Sep 25 00:51:16.885624 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27222047-f6bb-4303-85db-be113972492f admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:16.910117 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 756/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Sep 25 00:51:16 2022] PUT /identity/v3/projects/b5be34442f48425ba00380a0f37a78a6/users/944a038f2bb94068887e0a8fae11041c/roles/eab9c0818aa3414eb3a1a155830ad262 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:51:16.922344 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e9dc5-13ed-4dd2-8ae1-f36d417b169a None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:16.922675 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e9dc5-13ed-4dd2-8ae1-f36d417b169a None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:16.922955 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e9dc5-13ed-4dd2-8ae1-f36d417b169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:16.979957 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-b38e9dc5-13ed-4dd2-8ae1-f36d417b169a None None] MFA Rules not processed for user `944a038f2bb94068887e0a8fae11041c`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:16.981128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-b38e9dc5-13ed-4dd2-8ae1-f36d417b169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:17.057180 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 746/1502] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:51:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:17.070950 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538145c-145a-4d92-817f-ebf4adfc0bd6 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:17.071247 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538145c-145a-4d92-817f-ebf4adfc0bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:17.071525 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538145c-145a-4d92-817f-ebf4adfc0bd6 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:17.072886 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 757/1503] 10.222.0.27 () {54 vars in 963 bytes} [Sun Sep 25 00:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:17.077583 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189dbd-d605-4ca7-8567-14d90e683d2c None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:17.077873 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189dbd-d605-4ca7-8567-14d90e683d2c None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:17.078150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189dbd-d605-4ca7-8567-14d90e683d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:17.109438 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:17.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-e4189dbd-d605-4ca7-8567-14d90e683d2c None None] MFA Rules not processed for user `41cd0c4bf9734339ba9e8f2dabb9a0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:17.155005 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-e4189dbd-d605-4ca7-8567-14d90e683d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:17.234625 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 747/1504] 10.222.0.27 () {58 vars in 1060 bytes} [Sun Sep 25 00:51:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:51:17.244812 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538145c-145a-4d92-817f-ebf4adfc0bd6 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:17.246352 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-d538145c-145a-4d92-817f-ebf4adfc0bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:17.294342 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:17.348072 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538145c-145a-4d92-817f-ebf4adfc0bd6 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:17.420241 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12236db9-cc8a-4c7e-a10f-568da9544af1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41cd0c4bf9734339ba9e8f2dabb9a0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:17.420866 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236db9-cc8a-4c7e-a10f-568da9544af1 service cinder] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:17.421141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236db9-cc8a-4c7e-a10f-568da9544af1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:17.421405 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236db9-cc8a-4c7e-a10f-568da9544af1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:17.422982 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-12236db9-cc8a-4c7e-a10f-568da9544af1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:17.519414 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12236db9-cc8a-4c7e-a10f-568da9544af1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:17.520791 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12236db9-cc8a-4c7e-a10f-568da9544af1 service cinder] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:17.524224 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:17.538601 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 758/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:17.584236 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f903040-0199-4d89-bcf7-f053f7cae3ef None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:17.584523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f903040-0199-4d89-bcf7-f053f7cae3ef None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:17.584825 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f903040-0199-4d89-bcf7-f053f7cae3ef None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:17.586610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 748/1506] 10.222.0.27 () {52 vars in 830 bytes} [Sun Sep 25 00:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:17.590113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12236db9-cc8a-4c7e-a10f-568da9544af1 service cinder] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:17.591325 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-12236db9-cc8a-4c7e-a10f-568da9544af1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:17.688468 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12236db9-cc8a-4c7e-a10f-568da9544af1 service cinder] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:17.782280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:17.782832 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:17.783110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:17.783383 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] PATH_INFO: `/v3/users/944a038f2bb94068887e0a8fae11041c` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:17.796895 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=944a038f2bb94068887e0a8fae11041c)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:17.797927 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: WARNING py.warnings [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:51:17.797927 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: warnings.warn(msg) Sep 25 00:51:17.797927 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: Sep 25 00:51:17.799140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:17.808767 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:17.864378 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '944a038f2bb94068887e0a8fae11041c'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:51:17.886755 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '944a038f2bb94068887e0a8fae11041c'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:51:17.901110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '944a038f2bb94068887e0a8fae11041c'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:51:17.910083 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '944a038f2bb94068887e0a8fae11041c'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:51:17.910564 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '944a038f2bb94068887e0a8fae11041c'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:51:17.916728 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 759/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Sep 25 00:51:17 2022] DELETE /identity/v3/users/944a038f2bb94068887e0a8fae11041c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:51:17.921078 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc35f0-bbe9-430c-a049-ff30646399a8 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:17.921528 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc35f0-bbe9-430c-a049-ff30646399a8 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:17.921685 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc35f0-bbe9-430c-a049-ff30646399a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:17.977772 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-86fc35f0-bbe9-430c-a049-ff30646399a8 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:17.978984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-86fc35f0-bbe9-430c-a049-ff30646399a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:18.053100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:18.065798 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 749/1508] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:18.075806 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:18.077068 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:18.175727 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad907b-338d-4478-8f50-833a4ff2b2bd admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:18.230359 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:18.249732 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0904c1-e8f5-4b42-87b0-f920f58a2da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:18.250353 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0904c1-e8f5-4b42-87b0-f920f58a2da4 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:18.250631 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0904c1-e8f5-4b42-87b0-f920f58a2da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:18.250905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0904c1-e8f5-4b42-87b0-f920f58a2da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:18.252534 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-0a0904c1-e8f5-4b42-87b0-f920f58a2da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:18.363330 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0904c1-e8f5-4b42-87b0-f920f58a2da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:18.364726 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0904c1-e8f5-4b42-87b0-f920f58a2da4 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:18.382759 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 760/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:18.732808 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc35f0-bbe9-430c-a049-ff30646399a8 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:18.734164 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-86fc35f0-bbe9-430c-a049-ff30646399a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:18.746747 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc35f0-bbe9-430c-a049-ff30646399a8 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:18.848059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5934e-b2ad-4706-b5ff-13591c8e9b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:18.848721 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5934e-b2ad-4706-b5ff-13591c8e9b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:18.848997 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5934e-b2ad-4706-b5ff-13591c8e9b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:18.849263 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5934e-b2ad-4706-b5ff-13591c8e9b70 admin admin] PATH_INFO: `/v3/projects/b5be34442f48425ba00380a0f37a78a6` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:18.859287 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5934e-b2ad-4706-b5ff-13591c8e9b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5be34442f48425ba00380a0f37a78a6)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:18.860293 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: WARNING py.warnings [None req-06f5934e-b2ad-4706-b5ff-13591c8e9b70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:51:18.860293 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: warnings.warn(msg) Sep 25 00:51:18.860293 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: Sep 25 00:51:18.861518 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5934e-b2ad-4706-b5ff-13591c8e9b70 admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:18.918365 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-06f5934e-b2ad-4706-b5ff-13591c8e9b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5be34442f48425ba00380a0f37a78a6', 'request_id': 'req-06f5934e-b2ad-4706-b5ff-13591c8e9b70'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:51:18.932404 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-06f5934e-b2ad-4706-b5ff-13591c8e9b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5be34442f48425ba00380a0f37a78a6', 'request_id': 'req-06f5934e-b2ad-4706-b5ff-13591c8e9b70'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:51:18.938482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-06f5934e-b2ad-4706-b5ff-13591c8e9b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5be34442f48425ba00380a0f37a78a6', 'request_id': 'req-06f5934e-b2ad-4706-b5ff-13591c8e9b70'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:51:18.965377 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-06f5934e-b2ad-4706-b5ff-13591c8e9b70 admin admin] The token cache is being invalidate because project b5be34442f48425ba00380a0f37a78a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 00:51:18.965674 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-06f5934e-b2ad-4706-b5ff-13591c8e9b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:51:18.966106 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-06f5934e-b2ad-4706-b5ff-13591c8e9b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:51:18.967508 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 750/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Sep 25 00:51:18 2022] DELETE /identity/v3/projects/b5be34442f48425ba00380a0f37a78a6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:51:28.380508 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=62 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:28.963225 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:33.608184 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbfc9b-4b7a-46e0-8855-d9501978b0d6 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:33.608817 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbfc9b-4b7a-46e0-8855-d9501978b0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:33.608817 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbfc9b-4b7a-46e0-8855-d9501978b0d6 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:33.610151 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:33.614887 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0faa1b-12fb-4ce6-b6af-911c12c1d009 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:33.615319 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0faa1b-12fb-4ce6-b6af-911c12c1d009 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:33.615446 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0faa1b-12fb-4ce6-b6af-911c12c1d009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:33.695966 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-ba0faa1b-12fb-4ce6-b6af-911c12c1d009 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:33.697218 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-ba0faa1b-12fb-4ce6-b6af-911c12c1d009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:33.798413 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:33.953396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbfc9b-4b7a-46e0-8855-d9501978b0d6 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:33.955630 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-0ecbfc9b-4b7a-46e0-8855-d9501978b0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:34.072804 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbfc9b-4b7a-46e0-8855-d9501978b0d6 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:34.078196 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd8d9a-6710-4f99-9f0c-3d7a5a85a3ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:34.078799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd8d9a-6710-4f99-9f0c-3d7a5a85a3ee service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:34.079079 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd8d9a-6710-4f99-9f0c-3d7a5a85a3ee service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:34.079354 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd8d9a-6710-4f99-9f0c-3d7a5a85a3ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:34.087422 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd8d9a-6710-4f99-9f0c-3d7a5a85a3ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:34.089040 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd8d9a-6710-4f99-9f0c-3d7a5a85a3ee service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:34.098188 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 762/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:35.163827 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de50c8-67e8-49d7-9622-09114b5d6119 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:35.164366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de50c8-67e8-49d7-9622-09114b5d6119 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:35.164366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de50c8-67e8-49d7-9622-09114b5d6119 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:35.165750 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:35.172385 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e088618-7496-4a01-bcf2-cd6acdfb5fb6 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:35.172845 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e088618-7496-4a01-bcf2-cd6acdfb5fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:35.172948 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e088618-7496-4a01-bcf2-cd6acdfb5fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:35.191918 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-8e088618-7496-4a01-bcf2-cd6acdfb5fb6 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:35.193141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-8e088618-7496-4a01-bcf2-cd6acdfb5fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:35.200848 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:35.350531 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de50c8-67e8-49d7-9622-09114b5d6119 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:35.365258 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de50c8-67e8-49d7-9622-09114b5d6119 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:35.370859 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d10205-a0c4-42b6-a9a9-ac362db36d67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:35.371458 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d10205-a0c4-42b6-a9a9-ac362db36d67 service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:35.371739 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d10205-a0c4-42b6-a9a9-ac362db36d67 service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:35.372012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d10205-a0c4-42b6-a9a9-ac362db36d67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:35.384091 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d10205-a0c4-42b6-a9a9-ac362db36d67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:35.386519 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d10205-a0c4-42b6-a9a9-ac362db36d67 service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:35.397296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 753/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:37.631073 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e70f22-e2d7-441d-929b-821abd46d404 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:37.631593 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e70f22-e2d7-441d-929b-821abd46d404 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:37.631689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e70f22-e2d7-441d-929b-821abd46d404 None None] PATH_INFO: `/v3` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:37.632921 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 764/1517] 10.222.0.33 () {54 vars in 925 bytes} [Sun Sep 25 00:52:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:52:37.639380 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d3ca2-6e95-4078-ae5b-19996324a453 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:37.639847 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d3ca2-6e95-4078-ae5b-19996324a453 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:37.639945 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d3ca2-6e95-4078-ae5b-19996324a453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:37.697811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-3f8d3ca2-6e95-4078-ae5b-19996324a453 None None] MFA Rules not processed for user `bac1aba93232486eb2bd5b3200cb6fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:37.698947 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-3f8d3ca2-6e95-4078-ae5b-19996324a453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:37.716033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:37.772742 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 754/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Sun Sep 25 00:52:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:45.187115 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=56 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:46.290409 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890a768-a7cb-4885-8e5f-f2844dc43419 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:46.291004 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890a768-a7cb-4885-8e5f-f2844dc43419 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:46.291004 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890a768-a7cb-4885-8e5f-f2844dc43419 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:46.292276 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 765/1519] 10.222.0.27 () {54 vars in 961 bytes} [Sun Sep 25 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:52:46.297363 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60850b-211a-4e6f-b2ca-252c8c7428dc None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:46.297792 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60850b-211a-4e6f-b2ca-252c8c7428dc None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:46.297918 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60850b-211a-4e6f-b2ca-252c8c7428dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:46.317304 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-3c60850b-211a-4e6f-b2ca-252c8c7428dc None None] MFA Rules not processed for user `bac1aba93232486eb2bd5b3200cb6fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:46.318559 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-3c60850b-211a-4e6f-b2ca-252c8c7428dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:46.327603 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 755/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Sep 25 00:52:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:52:46.335655 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890a768-a7cb-4885-8e5f-f2844dc43419 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:46.349871 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890a768-a7cb-4885-8e5f-f2844dc43419 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:46.354820 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53ac45-7333-4895-ab9f-4bb0f79e7d6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac1aba93232486eb2bd5b3200cb6fba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:46.355413 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53ac45-7333-4895-ab9f-4bb0f79e7d6b service placement] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:46.355689 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53ac45-7333-4895-ab9f-4bb0f79e7d6b service placement] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:46.355966 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53ac45-7333-4895-ab9f-4bb0f79e7d6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:46.364189 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53ac45-7333-4895-ab9f-4bb0f79e7d6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:46.365798 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53ac45-7333-4895-ab9f-4bb0f79e7d6b service placement] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:46.375698 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 766/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:46.853327 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef22589-2ceb-4e8d-bd8b-375df6f0b038 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:46.853619 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef22589-2ceb-4e8d-bd8b-375df6f0b038 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:46.853900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef22589-2ceb-4e8d-bd8b-375df6f0b038 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:46.855240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:46.862078 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae06a2-ac90-4bde-84c9-008354ae5d48 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:46.862366 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae06a2-ac90-4bde-84c9-008354ae5d48 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:46.862643 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae06a2-ac90-4bde-84c9-008354ae5d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:46.882443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-5eae06a2-ac90-4bde-84c9-008354ae5d48 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:46.883635 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-5eae06a2-ac90-4bde-84c9-008354ae5d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:46.892832 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:47.048665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef22589-2ceb-4e8d-bd8b-375df6f0b038 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:47.063609 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef22589-2ceb-4e8d-bd8b-375df6f0b038 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:47.068914 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4584c-8d80-4f1a-9de4-bbbc7923f1b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:47.069503 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4584c-8d80-4f1a-9de4-bbbc7923f1b0 service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:47.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4584c-8d80-4f1a-9de4-bbbc7923f1b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:47.070055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4584c-8d80-4f1a-9de4-bbbc7923f1b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:47.077923 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4584c-8d80-4f1a-9de4-bbbc7923f1b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:47.079489 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4584c-8d80-4f1a-9de4-bbbc7923f1b0 service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:47.088848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 757/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:48.162957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe6d3d-6d7f-4477-900d-7aa785e8a040 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:48.163498 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe6d3d-6d7f-4477-900d-7aa785e8a040 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:48.163498 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe6d3d-6d7f-4477-900d-7aa785e8a040 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:48.164873 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:48.171681 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e93de-a48c-4d16-939e-e8e0e27d610e None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:48.172125 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e93de-a48c-4d16-939e-e8e0e27d610e None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:48.172229 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e93de-a48c-4d16-939e-e8e0e27d610e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:48.191076 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-693e93de-a48c-4d16-939e-e8e0e27d610e None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:48.192264 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-693e93de-a48c-4d16-939e-e8e0e27d610e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:48.200602 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:48.350294 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe6d3d-6d7f-4477-900d-7aa785e8a040 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:48.365194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe6d3d-6d7f-4477-900d-7aa785e8a040 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:48.370600 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dc973-ba79-4afa-8767-5787881073f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:48.371191 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dc973-ba79-4afa-8767-5787881073f9 service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:48.371468 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dc973-ba79-4afa-8767-5787881073f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:48.371743 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dc973-ba79-4afa-8767-5787881073f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:48.379896 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dc973-ba79-4afa-8767-5787881073f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:48.381518 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dc973-ba79-4afa-8767-5787881073f9 service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:48.393208 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 769/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:52.395049 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199a31a-2f81-4373-bd72-7587a87abfd3 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:52.395621 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199a31a-2f81-4373-bd72-7587a87abfd3 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:52.395621 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199a31a-2f81-4373-bd72-7587a87abfd3 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:52.396969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:52.402067 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb8fcb-075b-476e-8873-d0e030e10bd2 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:52.402484 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb8fcb-075b-476e-8873-d0e030e10bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:52.402618 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb8fcb-075b-476e-8873-d0e030e10bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:52.421519 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-27fb8fcb-075b-476e-8873-d0e030e10bd2 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:52.422710 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-27fb8fcb-075b-476e-8873-d0e030e10bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:52.430402 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:52.725279 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199a31a-2f81-4373-bd72-7587a87abfd3 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:52.726993 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-b199a31a-2f81-4373-bd72-7587a87abfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:52.805961 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199a31a-2f81-4373-bd72-7587a87abfd3 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:52.809495 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5558116-245a-40bd-8b2b-4614386d90ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:52.810130 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5558116-245a-40bd-8b2b-4614386d90ed service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:52.810658 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5558116-245a-40bd-8b2b-4614386d90ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:52.810658 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5558116-245a-40bd-8b2b-4614386d90ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:52.820309 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5558116-245a-40bd-8b2b-4614386d90ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:52.821822 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5558116-245a-40bd-8b2b-4614386d90ed service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:52.831891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 760/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:54.960744 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7d28b-c233-4f39-8e88-4ad34ca2c8dd None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:54.961309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7d28b-c233-4f39-8e88-4ad34ca2c8dd None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:54.961309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7d28b-c233-4f39-8e88-4ad34ca2c8dd None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:54.962607 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:54.968347 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945467-82b8-4f75-a537-faf5a1c2e638 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:54.968807 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945467-82b8-4f75-a537-faf5a1c2e638 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:54.968910 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945467-82b8-4f75-a537-faf5a1c2e638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:54.988860 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-cc945467-82b8-4f75-a537-faf5a1c2e638 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:54.990087 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-cc945467-82b8-4f75-a537-faf5a1c2e638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:54.997773 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:55.281984 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7d28b-c233-4f39-8e88-4ad34ca2c8dd None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:55.292790 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7d28b-c233-4f39-8e88-4ad34ca2c8dd None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:55.296290 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b7ec5-966c-4c6c-b638-1c76d6725ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:55.296929 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b7ec5-966c-4c6c-b638-1c76d6725ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:55.297211 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b7ec5-966c-4c6c-b638-1c76d6725ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:55.297494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b7ec5-966c-4c6c-b638-1c76d6725ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:55.306264 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b7ec5-966c-4c6c-b638-1c76d6725ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:55.307702 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b7ec5-966c-4c6c-b638-1c76d6725ce9 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:55.317028 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 772/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:59.187249 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff69d9d-ff98-473d-ba97-de5415b8e468 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:59.187818 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff69d9d-ff98-473d-ba97-de5415b8e468 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:59.187818 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff69d9d-ff98-473d-ba97-de5415b8e468 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:59.189207 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:59.194666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e456c7c-e98f-49c7-9c86-f43ec8d632e8 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:59.195080 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e456c7c-e98f-49c7-9c86-f43ec8d632e8 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:59.195232 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e456c7c-e98f-49c7-9c86-f43ec8d632e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:59.215057 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-6e456c7c-e98f-49c7-9c86-f43ec8d632e8 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:59.216836 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-6e456c7c-e98f-49c7-9c86-f43ec8d632e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:59.224525 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:59.523593 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff69d9d-ff98-473d-ba97-de5415b8e468 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:59.525329 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-4ff69d9d-ff98-473d-ba97-de5415b8e468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:59.589154 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:59.603096 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff69d9d-ff98-473d-ba97-de5415b8e468 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:59.606707 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a5db6-1a63-4a9a-9668-36260bf8cb53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41cd0c4bf9734339ba9e8f2dabb9a0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:59.607316 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5db6-1a63-4a9a-9668-36260bf8cb53 service cinder] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:59.607594 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5db6-1a63-4a9a-9668-36260bf8cb53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:59.607868 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5db6-1a63-4a9a-9668-36260bf8cb53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:59.616799 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a5db6-1a63-4a9a-9668-36260bf8cb53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:59.618262 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a5db6-1a63-4a9a-9668-36260bf8cb53 service cinder] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:59.632486 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 763/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:01.769692 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5c9a-350e-464a-bf44-5f1f01306ca6 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:01.770255 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5c9a-350e-464a-bf44-5f1f01306ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:01.770255 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5c9a-350e-464a-bf44-5f1f01306ca6 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:01.771589 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:53:01.776771 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e043ba9-5e78-49e2-b95d-47de28a18bfe None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:01.777198 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e043ba9-5e78-49e2-b95d-47de28a18bfe None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:01.777335 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e043ba9-5e78-49e2-b95d-47de28a18bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:01.796967 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-9e043ba9-5e78-49e2-b95d-47de28a18bfe None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:53:01.798209 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-9e043ba9-5e78-49e2-b95d-47de28a18bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:01.806019 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:53:02.129917 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa5c9a-350e-464a-bf44-5f1f01306ca6 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:53:02.131664 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-05fa5c9a-350e-464a-bf44-5f1f01306ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:02.144770 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa5c9a-350e-464a-bf44-5f1f01306ca6 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:53:02.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc6ddf-263e-4bcd-915b-4c60b4d18e4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41cd0c4bf9734339ba9e8f2dabb9a0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:53:02.148846 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc6ddf-263e-4bcd-915b-4c60b4d18e4b service cinder] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:02.149125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc6ddf-263e-4bcd-915b-4c60b4d18e4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:02.149396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc6ddf-263e-4bcd-915b-4c60b4d18e4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:02.158672 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc6ddf-263e-4bcd-915b-4c60b4d18e4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:53:02.160100 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc6ddf-263e-4bcd-915b-4c60b4d18e4b service cinder] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:53:02.169900 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 775/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:11.791664 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=11 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:12.165307 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=33 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:54:19.462022 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db383b52-8f2a-4ee4-bbb5-cd6b2834f928 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.462649 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db383b52-8f2a-4ee4-bbb5-cd6b2834f928 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.462759 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fae52-887b-4211-a5c4-c036945e0ad9 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.463134 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db383b52-8f2a-4ee4-bbb5-cd6b2834f928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.463236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fae52-887b-4211-a5c4-c036945e0ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.463236 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fae52-887b-4211-a5c4-c036945e0ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.483114 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-db383b52-8f2a-4ee4-bbb5-cd6b2834f928 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:19.484325 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-db383b52-8f2a-4ee4-bbb5-cd6b2834f928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:19.487118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-ee3fae52-887b-4211-a5c4-c036945e0ad9 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:19.488304 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-ee3fae52-887b-4211-a5c4-c036945e0ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:19.492354 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 765/1540] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:19.496141 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 776/1541] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:54:19.500138 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03628fe8-ffb6-43b9-a21d-8b458c3669e0 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.500429 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03628fe8-ffb6-43b9-a21d-8b458c3669e0 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.500738 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03628fe8-ffb6-43b9-a21d-8b458c3669e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.504232 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ea684-aad3-4870-8f93-4d92fa221faa None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.504519 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ea684-aad3-4870-8f93-4d92fa221faa None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.504827 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ea684-aad3-4870-8f93-4d92fa221faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.519597 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-03628fe8-ffb6-43b9-a21d-8b458c3669e0 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:19.520823 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-03628fe8-ffb6-43b9-a21d-8b458c3669e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:19.524010 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-4b5ea684-aad3-4870-8f93-4d92fa221faa None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:19.525222 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-4b5ea684-aad3-4870-8f93-4d92fa221faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:19.529098 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 766/1542] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:19.533534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03628fe8-ffb6-43b9-a21d-8b458c3669e0 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:19.533799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 777/1543] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:54:19.538223 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ea684-aad3-4870-8f93-4d92fa221faa None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:19.543177 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03628fe8-ffb6-43b9-a21d-8b458c3669e0 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:19.547543 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ea684-aad3-4870-8f93-4d92fa221faa None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:19.547758 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc8180-1bb4-4828-921f-4684451f3517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:19.548342 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc8180-1bb4-4828-921f-4684451f3517 admin admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.548649 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc8180-1bb4-4828-921f-4684451f3517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.548926 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc8180-1bb4-4828-921f-4684451f3517 admin admin] PATH_INFO: `/v3/domains` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.549562 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc8180-1bb4-4828-921f-4684451f3517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:54:19.549863 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc8180-1bb4-4828-921f-4684451f3517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:19.551454 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc8180-1bb4-4828-921f-4684451f3517 admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:19.552185 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23403d7d-4b2d-42a1-a8da-7565ca7f1fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:19.552791 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403d7d-4b2d-42a1-a8da-7565ca7f1fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.553074 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403d7d-4b2d-42a1-a8da-7565ca7f1fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.553349 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403d7d-4b2d-42a1-a8da-7565ca7f1fe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.553984 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403d7d-4b2d-42a1-a8da-7565ca7f1fe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:54:19.554291 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403d7d-4b2d-42a1-a8da-7565ca7f1fe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:19.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: WARNING py.warnings [None req-23403d7d-4b2d-42a1-a8da-7565ca7f1fe4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:54:19.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: warnings.warn(msg) Sep 25 00:54:19.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: Sep 25 00:54:19.556184 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403d7d-4b2d-42a1-a8da-7565ca7f1fe4 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:19.563027 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 767/1544] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Sep 25 00:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:54:19.568327 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 778/1545] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Sep 25 00:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:54:19.570740 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc8180-1bb4-4828-921f-4684451f3517 admin admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:19.575828 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23403d7d-4b2d-42a1-a8da-7565ca7f1fe4 admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:19.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc8180-1bb4-4828-921f-4684451f3517 admin admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:19.585284 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801d38d-1e46-4e05-b25e-2551150e77f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:19.585857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23403d7d-4b2d-42a1-a8da-7565ca7f1fe4 admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:19.585970 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801d38d-1e46-4e05-b25e-2551150e77f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.586139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801d38d-1e46-4e05-b25e-2551150e77f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.586472 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801d38d-1e46-4e05-b25e-2551150e77f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.587040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801d38d-1e46-4e05-b25e-2551150e77f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:19.588045 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: WARNING py.warnings [None req-3801d38d-1e46-4e05-b25e-2551150e77f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:54:19.588045 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: warnings.warn(msg) Sep 25 00:54:19.588045 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: Sep 25 00:54:19.589769 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801d38d-1e46-4e05-b25e-2551150e77f8 admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:19.591031 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913be83-7a83-43f7-b1a1-b92e08cf9ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:19.591612 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913be83-7a83-43f7-b1a1-b92e08cf9ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.591897 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913be83-7a83-43f7-b1a1-b92e08cf9ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.592177 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913be83-7a83-43f7-b1a1-b92e08cf9ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.592836 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913be83-7a83-43f7-b1a1-b92e08cf9ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:19.594735 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913be83-7a83-43f7-b1a1-b92e08cf9ae8 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:19.628043 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 768/1546] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Sep 25 00:54:19 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:54:19.631976 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801d38d-1e46-4e05-b25e-2551150e77f8 admin admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:19.635580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 779/1547] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Sep 25 00:54:19 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:54:19.636457 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913be83-7a83-43f7-b1a1-b92e08cf9ae8 admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:19.694411 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801d38d-1e46-4e05-b25e-2551150e77f8 admin admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:19.697344 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913be83-7a83-43f7-b1a1-b92e08cf9ae8 admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:19.699086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488691cb-f145-41af-b0a6-88523b72456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:19.699690 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488691cb-f145-41af-b0a6-88523b72456d admin admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.699968 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488691cb-f145-41af-b0a6-88523b72456d admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.700244 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488691cb-f145-41af-b0a6-88523b72456d admin admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.700900 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488691cb-f145-41af-b0a6-88523b72456d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:19.702087 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2df95c-b68a-4441-9420-98496d6a83df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:19.702683 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2df95c-b68a-4441-9420-98496d6a83df admin admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.702827 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488691cb-f145-41af-b0a6-88523b72456d admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:19.702959 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2df95c-b68a-4441-9420-98496d6a83df admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.703229 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2df95c-b68a-4441-9420-98496d6a83df admin admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.703862 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2df95c-b68a-4441-9420-98496d6a83df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:19.704894 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: WARNING py.warnings [None req-4b2df95c-b68a-4441-9420-98496d6a83df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:54:19.704894 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: warnings.warn(msg) Sep 25 00:54:19.704894 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: Sep 25 00:54:19.706088 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2df95c-b68a-4441-9420-98496d6a83df admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:19.725226 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 769/1548] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Sep 25 00:54:19 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:54:19.732431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 780/1549] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Sep 25 00:54:19 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:54:19.732631 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488691cb-f145-41af-b0a6-88523b72456d admin admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:19.733462 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2df95c-b68a-4441-9420-98496d6a83df admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:19.739209 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488691cb-f145-41af-b0a6-88523b72456d admin admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:19.742805 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2df95c-b68a-4441-9420-98496d6a83df admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:19.743767 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e592b3a-094c-459a-834d-d7a2854c79af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:19.744354 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e592b3a-094c-459a-834d-d7a2854c79af admin admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.744661 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e592b3a-094c-459a-834d-d7a2854c79af admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.744958 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e592b3a-094c-459a-834d-d7a2854c79af admin admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.745594 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e592b3a-094c-459a-834d-d7a2854c79af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:19.747204 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e592b3a-094c-459a-834d-d7a2854c79af admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:19.747735 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d53310-8f4c-4456-89fd-5124f3f47e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:19.748515 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d53310-8f4c-4456-89fd-5124f3f47e37 admin admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.748842 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d53310-8f4c-4456-89fd-5124f3f47e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.749474 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d53310-8f4c-4456-89fd-5124f3f47e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.750125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d53310-8f4c-4456-89fd-5124f3f47e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:19.751933 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d53310-8f4c-4456-89fd-5124f3f47e37 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:19.757033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 770/1550] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Sep 25 00:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 00:54:19.761329 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e592b3a-094c-459a-834d-d7a2854c79af admin admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:19.763797 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 781/1551] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Sep 25 00:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:54:19.768209 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d53310-8f4c-4456-89fd-5124f3f47e37 admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:19.770905 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e592b3a-094c-459a-834d-d7a2854c79af admin admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:19.776668 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebf80f-7ccc-4130-90ce-a1a3bb39891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:19.777266 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebf80f-7ccc-4130-90ce-a1a3bb39891e admin admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.777545 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebf80f-7ccc-4130-90ce-a1a3bb39891e admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.777821 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebf80f-7ccc-4130-90ce-a1a3bb39891e admin admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.778315 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d53310-8f4c-4456-89fd-5124f3f47e37 admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:19.778452 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebf80f-7ccc-4130-90ce-a1a3bb39891e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:19.780039 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebf80f-7ccc-4130-90ce-a1a3bb39891e admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:19.782817 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066f3f4-c0e2-4874-a4a2-6382ddead2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:19.783388 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066f3f4-c0e2-4874-a4a2-6382ddead2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.783685 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066f3f4-c0e2-4874-a4a2-6382ddead2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.783958 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066f3f4-c0e2-4874-a4a2-6382ddead2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.784617 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066f3f4-c0e2-4874-a4a2-6382ddead2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:19.786217 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066f3f4-c0e2-4874-a4a2-6382ddead2d9 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:19.790526 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 771/1552] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Sep 25 00:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 00:54:19.794550 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebf80f-7ccc-4130-90ce-a1a3bb39891e admin admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:19.800545 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 782/1553] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Sep 25 00:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:54:19.801494 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066f3f4-c0e2-4874-a4a2-6382ddead2d9 admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:19.805169 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebf80f-7ccc-4130-90ce-a1a3bb39891e admin admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:19.809894 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964d10f-defd-4f07-a515-57d9e09e356f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:19.810546 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964d10f-defd-4f07-a515-57d9e09e356f admin admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.810675 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066f3f4-c0e2-4874-a4a2-6382ddead2d9 admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:19.810879 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964d10f-defd-4f07-a515-57d9e09e356f admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.811106 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964d10f-defd-4f07-a515-57d9e09e356f admin admin] PATH_INFO: `/v3/projects/f3b9f79711ca45f8ae6d9835faa10c7f/users/1a7192041fb844ad9f9e8ff48606ee67/roles/eab9c0818aa3414eb3a1a155830ad262` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.818431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6b47a-67f0-4ee8-acdd-c34329ce331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:19.819077 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6b47a-67f0-4ee8-acdd-c34329ce331e admin admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.819351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6b47a-67f0-4ee8-acdd-c34329ce331e admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.819681 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6b47a-67f0-4ee8-acdd-c34329ce331e admin admin] PATH_INFO: `/v3/projects/594de123c0c84fe7a903e5dcdf90c29b/users/033af76f31cf40829e899b9f7644305f/roles/eab9c0818aa3414eb3a1a155830ad262` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.828743 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964d10f-defd-4f07-a515-57d9e09e356f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b9f79711ca45f8ae6d9835faa10c7f, user_id=1a7192041fb844ad9f9e8ff48606ee67, role_id=eab9c0818aa3414eb3a1a155830ad262)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:19.829783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: WARNING py.warnings [None req-6964d10f-defd-4f07-a515-57d9e09e356f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:54:19.829783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: warnings.warn(msg) Sep 25 00:54:19.829783 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: Sep 25 00:54:19.831734 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964d10f-defd-4f07-a515-57d9e09e356f admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:19.839230 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6b47a-67f0-4ee8-acdd-c34329ce331e admin admin] RBAC: Authorizing `identity:create_grant(project_id=594de123c0c84fe7a903e5dcdf90c29b, user_id=033af76f31cf40829e899b9f7644305f, role_id=eab9c0818aa3414eb3a1a155830ad262)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:19.842049 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6b47a-67f0-4ee8-acdd-c34329ce331e admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:19.845933 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 772/1554] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Sep 25 00:54:19 2022] PUT /identity/v3/projects/f3b9f79711ca45f8ae6d9835faa10c7f/users/1a7192041fb844ad9f9e8ff48606ee67/roles/eab9c0818aa3414eb3a1a155830ad262 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:54:19.851297 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5747-d96c-431a-91a1-a1cabf727b83 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.851586 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5747-d96c-431a-91a1-a1cabf727b83 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.851863 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5747-d96c-431a-91a1-a1cabf727b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.855037 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 783/1555] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Sep 25 00:54:19 2022] PUT /identity/v3/projects/594de123c0c84fe7a903e5dcdf90c29b/users/033af76f31cf40829e899b9f7644305f/roles/eab9c0818aa3414eb3a1a155830ad262 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:54:19.859939 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121236-c79d-408d-a189-95f1bb102373 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:19.860298 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121236-c79d-408d-a189-95f1bb102373 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:19.860706 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121236-c79d-408d-a189-95f1bb102373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:19.870804 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-3a9a5747-d96c-431a-91a1-a1cabf727b83 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:19.872128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-3a9a5747-d96c-431a-91a1-a1cabf727b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:19.879309 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-15121236-c79d-408d-a189-95f1bb102373 None None] MFA Rules not processed for user `19c04946a10143a58b50e26046837bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:19.880485 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-15121236-c79d-408d-a189-95f1bb102373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:19.914002 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:54:19.923191 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:54:19.934423 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 773/1556] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:54:19.944435 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5747-d96c-431a-91a1-a1cabf727b83 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:19.946042 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 784/1557] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:19.955972 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121236-c79d-408d-a189-95f1bb102373 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:19.998812 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5747-d96c-431a-91a1-a1cabf727b83 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:20.002449 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac2d8d-f163-4a19-aa9e-a12d764ed667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:20.003059 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac2d8d-f163-4a19-aa9e-a12d764ed667 service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:20.003404 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac2d8d-f163-4a19-aa9e-a12d764ed667 service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:20.003607 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac2d8d-f163-4a19-aa9e-a12d764ed667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:20.010917 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121236-c79d-408d-a189-95f1bb102373 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:20.013260 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac2d8d-f163-4a19-aa9e-a12d764ed667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:20.014656 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a41408-0ed1-4c03-bfe3-c49e8e62d24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:20.014839 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac2d8d-f163-4a19-aa9e-a12d764ed667 service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:20.015300 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a41408-0ed1-4c03-bfe3-c49e8e62d24b service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:20.015576 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a41408-0ed1-4c03-bfe3-c49e8e62d24b service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:20.015844 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a41408-0ed1-4c03-bfe3-c49e8e62d24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:20.024494 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 774/1558] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 00:54:20.025065 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a41408-0ed1-4c03-bfe3-c49e8e62d24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:20.027132 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a41408-0ed1-4c03-bfe3-c49e8e62d24b service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:20.036966 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 785/1559] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 00:54:25.112307 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf599c3d-3d02-40e0-a953-e633b42b88b4 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:25.112910 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf599c3d-3d02-40e0-a953-e633b42b88b4 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:25.112910 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf599c3d-3d02-40e0-a953-e633b42b88b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:25.178611 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-cf599c3d-3d02-40e0-a953-e633b42b88b4 None None] MFA Rules not processed for user `033af76f31cf40829e899b9f7644305f`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:25.180139 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-cf599c3d-3d02-40e0-a953-e633b42b88b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:25.319102 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 775/1560] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:54:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:25.323104 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a41408-0ed1-4c03-bfe3-c49e8e62d24b service neutron] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:25.338997 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a41408-0ed1-4c03-bfe3-c49e8e62d24b service neutron] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:25.346357 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262cf40-3880-4bd7-90f9-d8c2003a8964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:25.347177 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262cf40-3880-4bd7-90f9-d8c2003a8964 admin admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:25.347637 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262cf40-3880-4bd7-90f9-d8c2003a8964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:25.348075 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262cf40-3880-4bd7-90f9-d8c2003a8964 admin admin] PATH_INFO: `/v3/projects` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:25.348999 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262cf40-3880-4bd7-90f9-d8c2003a8964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:25.351505 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262cf40-3880-4bd7-90f9-d8c2003a8964 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:25.404044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 786/1561] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Sep 25 00:54:25 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:54:25.408040 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf599c3d-3d02-40e0-a953-e633b42b88b4 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:25.424296 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf599c3d-3d02-40e0-a953-e633b42b88b4 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:25.512659 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d8c8f-09c2-4723-8d18-a146e89f4261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:25.513579 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d8c8f-09c2-4723-8d18-a146e89f4261 admin admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:25.514011 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d8c8f-09c2-4723-8d18-a146e89f4261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:25.514417 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d8c8f-09c2-4723-8d18-a146e89f4261 admin admin] PATH_INFO: `/v3/users` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:25.515231 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d8c8f-09c2-4723-8d18-a146e89f4261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:25.517398 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d8c8f-09c2-4723-8d18-a146e89f4261 admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:25.550101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 776/1562] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Sep 25 00:54:25 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:54:25.554070 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262cf40-3880-4bd7-90f9-d8c2003a8964 admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:25.569956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262cf40-3880-4bd7-90f9-d8c2003a8964 admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:25.576351 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc71d1d-eae3-4b8c-8232-d5f9da39b7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:25.577011 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc71d1d-eae3-4b8c-8232-d5f9da39b7ca admin admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:25.577290 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc71d1d-eae3-4b8c-8232-d5f9da39b7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:25.577564 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc71d1d-eae3-4b8c-8232-d5f9da39b7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:25.578209 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc71d1d-eae3-4b8c-8232-d5f9da39b7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:25.580012 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc71d1d-eae3-4b8c-8232-d5f9da39b7ca admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:25.595956 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 787/1563] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Sep 25 00:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:54:25.597234 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d8c8f-09c2-4723-8d18-a146e89f4261 admin admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:25.610492 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d8c8f-09c2-4723-8d18-a146e89f4261 admin admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:25.630033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efaf29-039f-42c0-bd39-335e57b40072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:25.631155 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efaf29-039f-42c0-bd39-335e57b40072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:25.631608 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efaf29-039f-42c0-bd39-335e57b40072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:25.631889 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efaf29-039f-42c0-bd39-335e57b40072 admin admin] PATH_INFO: `/v3/projects/37c98b187f0142c9bd8c4d151a93e36a/users/e7f2f98d23f14db3ba173a3d42924f11/roles/a6d585feb70946b1b1ebcaece17d26b2` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:25.636685 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:54:25.672660 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efaf29-039f-42c0-bd39-335e57b40072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c98b187f0142c9bd8c4d151a93e36a, user_id=e7f2f98d23f14db3ba173a3d42924f11, role_id=a6d585feb70946b1b1ebcaece17d26b2)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:25.676055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efaf29-039f-42c0-bd39-335e57b40072 admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:25.707382 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 777/1564] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Sep 25 00:54:25 2022] PUT /identity/v3/projects/37c98b187f0142c9bd8c4d151a93e36a/users/e7f2f98d23f14db3ba173a3d42924f11/roles/a6d585feb70946b1b1ebcaece17d26b2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:54:25.711465 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc71d1d-eae3-4b8c-8232-d5f9da39b7ca admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:25.724840 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc71d1d-eae3-4b8c-8232-d5f9da39b7ca admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:25.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4aa7e-a949-49d6-8810-4302fffb4510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:25.855827 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4aa7e-a949-49d6-8810-4302fffb4510 admin admin] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:25.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4aa7e-a949-49d6-8810-4302fffb4510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:25.856800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4aa7e-a949-49d6-8810-4302fffb4510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:25.857547 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4aa7e-a949-49d6-8810-4302fffb4510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:25.859270 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4aa7e-a949-49d6-8810-4302fffb4510 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:25.876587 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 788/1565] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Sep 25 00:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:54:25.879677 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efaf29-039f-42c0-bd39-335e57b40072 admin admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:25.894711 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efaf29-039f-42c0-bd39-335e57b40072 admin admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:25.902471 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db2adb-623d-4b17-87bc-6dcc85d094fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:25.903153 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db2adb-623d-4b17-87bc-6dcc85d094fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:25.903439 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db2adb-623d-4b17-87bc-6dcc85d094fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:25.903718 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db2adb-623d-4b17-87bc-6dcc85d094fd admin admin] PATH_INFO: `/v3/projects/37c98b187f0142c9bd8c4d151a93e36a/users/e7f2f98d23f14db3ba173a3d42924f11/roles/a6d585feb70946b1b1ebcaece17d26b2` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:25.905965 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db2adb-623d-4b17-87bc-6dcc85d094fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c98b187f0142c9bd8c4d151a93e36a, user_id=e7f2f98d23f14db3ba173a3d42924f11, role_id=a6d585feb70946b1b1ebcaece17d26b2)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:25.909095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db2adb-623d-4b17-87bc-6dcc85d094fd admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:25.925101 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 778/1566] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Sep 25 00:54:25 2022] PUT /identity/v3/projects/37c98b187f0142c9bd8c4d151a93e36a/users/e7f2f98d23f14db3ba173a3d42924f11/roles/a6d585feb70946b1b1ebcaece17d26b2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:54:26.076046 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922185a-9d52-498c-a934-18488bf2f578 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:26.076683 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922185a-9d52-498c-a934-18488bf2f578 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:26.077151 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922185a-9d52-498c-a934-18488bf2f578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:26.118621 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-e922185a-9d52-498c-a934-18488bf2f578 None None] MFA Rules not processed for user `1a7192041fb844ad9f9e8ff48606ee67`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:26.121708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-e922185a-9d52-498c-a934-18488bf2f578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:26.175230 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:54:26.201654 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 789/1567] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:54:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:26.206152 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db2adb-623d-4b17-87bc-6dcc85d094fd admin admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:26.283423 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db2adb-623d-4b17-87bc-6dcc85d094fd admin admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:26.293003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac545f86-ba4f-4d7c-8d67-0c2664088f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:26.293648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac545f86-ba4f-4d7c-8d67-0c2664088f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:26.293927 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac545f86-ba4f-4d7c-8d67-0c2664088f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:26.294198 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac545f86-ba4f-4d7c-8d67-0c2664088f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:26.294868 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac545f86-ba4f-4d7c-8d67-0c2664088f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:26.297568 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac545f86-ba4f-4d7c-8d67-0c2664088f8d admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:26.366265 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 779/1568] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Sep 25 00:54:26 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:54:26.371529 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922185a-9d52-498c-a934-18488bf2f578 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:26.396109 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922185a-9d52-498c-a934-18488bf2f578 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:26.476954 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e5279-672a-4190-bd3d-100ff504f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:26.477578 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e5279-672a-4190-bd3d-100ff504f858 admin admin] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:26.477884 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e5279-672a-4190-bd3d-100ff504f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:26.478167 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e5279-672a-4190-bd3d-100ff504f858 admin admin] PATH_INFO: `/v3/users` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:26.479401 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e5279-672a-4190-bd3d-100ff504f858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:26.481411 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e5279-672a-4190-bd3d-100ff504f858 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:26.515296 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 790/1569] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Sep 25 00:54:26 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:54:26.516693 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac545f86-ba4f-4d7c-8d67-0c2664088f8d admin admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:26.533103 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac545f86-ba4f-4d7c-8d67-0c2664088f8d admin admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:26.537988 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445386cc-a437-43f0-a739-d7a9c9bdd69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:26.538617 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445386cc-a437-43f0-a739-d7a9c9bdd69c admin admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:26.538903 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445386cc-a437-43f0-a739-d7a9c9bdd69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:26.539181 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445386cc-a437-43f0-a739-d7a9c9bdd69c admin admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:26.539842 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445386cc-a437-43f0-a739-d7a9c9bdd69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:26.541540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445386cc-a437-43f0-a739-d7a9c9bdd69c admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:26.558699 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 780/1570] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Sep 25 00:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:54:26.559875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e5279-672a-4190-bd3d-100ff504f858 admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:26.575814 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e5279-672a-4190-bd3d-100ff504f858 admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:26.584643 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba253648-972a-4a84-9f94-32741c68f37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:26.585782 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba253648-972a-4a84-9f94-32741c68f37d admin admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:26.586223 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba253648-972a-4a84-9f94-32741c68f37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:26.586657 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba253648-972a-4a84-9f94-32741c68f37d admin admin] PATH_INFO: `/v3/projects/f7df8be82fb8449f97f85cc234eb97ab/users/4fc10d942976480b94486fc34b8aa3d6/roles/a6d585feb70946b1b1ebcaece17d26b2` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:26.607860 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba253648-972a-4a84-9f94-32741c68f37d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7df8be82fb8449f97f85cc234eb97ab, user_id=4fc10d942976480b94486fc34b8aa3d6, role_id=a6d585feb70946b1b1ebcaece17d26b2)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:26.611113 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba253648-972a-4a84-9f94-32741c68f37d admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:26.635839 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 791/1571] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Sep 25 00:54:26 2022] PUT /identity/v3/projects/f7df8be82fb8449f97f85cc234eb97ab/users/4fc10d942976480b94486fc34b8aa3d6/roles/a6d585feb70946b1b1ebcaece17d26b2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:54:26.639786 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445386cc-a437-43f0-a739-d7a9c9bdd69c admin admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:26.654848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445386cc-a437-43f0-a739-d7a9c9bdd69c admin admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:26.758430 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b9119-5d08-4187-b6df-f7e8909b3c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:26.759211 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b9119-5d08-4187-b6df-f7e8909b3c33 admin admin] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:26.760774 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b9119-5d08-4187-b6df-f7e8909b3c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:26.761201 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b9119-5d08-4187-b6df-f7e8909b3c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:26.761968 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b9119-5d08-4187-b6df-f7e8909b3c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:26.764450 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b9119-5d08-4187-b6df-f7e8909b3c33 admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:26.779313 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 781/1572] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Sep 25 00:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:54:26.783719 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba253648-972a-4a84-9f94-32741c68f37d admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:26.803126 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba253648-972a-4a84-9f94-32741c68f37d admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:26.814846 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddcbdc-461e-4ed9-a52a-a4fcd622b185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:26.814846 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddcbdc-461e-4ed9-a52a-a4fcd622b185 admin admin] REQUEST_METHOD: `PUT` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:26.815083 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddcbdc-461e-4ed9-a52a-a4fcd622b185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:26.815766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddcbdc-461e-4ed9-a52a-a4fcd622b185 admin admin] PATH_INFO: `/v3/projects/f7df8be82fb8449f97f85cc234eb97ab/users/4fc10d942976480b94486fc34b8aa3d6/roles/a6d585feb70946b1b1ebcaece17d26b2` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:26.824284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddcbdc-461e-4ed9-a52a-a4fcd622b185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7df8be82fb8449f97f85cc234eb97ab, user_id=4fc10d942976480b94486fc34b8aa3d6, role_id=a6d585feb70946b1b1ebcaece17d26b2)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:26.828748 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddcbdc-461e-4ed9-a52a-a4fcd622b185 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:26.843659 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 792/1573] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Sep 25 00:54:26 2022] PUT /identity/v3/projects/f7df8be82fb8449f97f85cc234eb97ab/users/4fc10d942976480b94486fc34b8aa3d6/roles/a6d585feb70946b1b1ebcaece17d26b2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:54:32.266726 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022972e-b169-4439-8c98-7e345560ac0f None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:32.267072 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022972e-b169-4439-8c98-7e345560ac0f None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:32.267227 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022972e-b169-4439-8c98-7e345560ac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:32.305408 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-8022972e-b169-4439-8c98-7e345560ac0f None None] MFA Rules not processed for user `e7f2f98d23f14db3ba173a3d42924f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:32.307148 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-8022972e-b169-4439-8c98-7e345560ac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:32.354156 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:54:32.441173 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 782/1574] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:54:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:32.451876 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddcbdc-461e-4ed9-a52a-a4fcd622b185 admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:32.454419 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-30ddcbdc-461e-4ed9-a52a-a4fcd622b185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:32.619943 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddcbdc-461e-4ed9-a52a-a4fcd622b185 admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:32.624145 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3352a-728f-4592-92bd-b97948a8c9f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2d0afc3294d75897dda3dd8f78aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:32.624797 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3352a-728f-4592-92bd-b97948a8c9f5 service glance] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:32.625074 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3352a-728f-4592-92bd-b97948a8c9f5 service glance] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:32.625396 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3352a-728f-4592-92bd-b97948a8c9f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:32.660520 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:54:32.703951 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3352a-728f-4592-92bd-b97948a8c9f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:32.706654 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3352a-728f-4592-92bd-b97948a8c9f5 service glance] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:32.728756 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 793/1575] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:54:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:54:33.014156 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b342f-d59a-4bf8-b2f8-5590385eca1d None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:33.014622 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b342f-d59a-4bf8-b2f8-5590385eca1d None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:33.014910 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b342f-d59a-4bf8-b2f8-5590385eca1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:33.102203 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-559b342f-d59a-4bf8-b2f8-5590385eca1d None None] MFA Rules not processed for user `6c53cca11c1c45a89651026d2ac75cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:33.104206 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-559b342f-d59a-4bf8-b2f8-5590385eca1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:33.219280 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 783/1576] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Sep 25 00:54:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:33.221038 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619731c2-14c2-4404-8c0a-0dbe742f3c98 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:33.221356 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619731c2-14c2-4404-8c0a-0dbe742f3c98 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:33.221641 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619731c2-14c2-4404-8c0a-0dbe742f3c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:33.262023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-619731c2-14c2-4404-8c0a-0dbe742f3c98 None None] MFA Rules not processed for user `4fc10d942976480b94486fc34b8aa3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:33.263239 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-619731c2-14c2-4404-8c0a-0dbe742f3c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:33.328393 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b342f-d59a-4bf8-b2f8-5590385eca1d None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:33.330073 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-559b342f-d59a-4bf8-b2f8-5590385eca1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:33.347578 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 794/1577] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:54:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:33.360531 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619731c2-14c2-4404-8c0a-0dbe742f3c98 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:33.375118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619731c2-14c2-4404-8c0a-0dbe742f3c98 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:33.379245 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e926ac5-d65c-496e-8c10-d97055ff89b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2d0afc3294d75897dda3dd8f78aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:33.379923 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e926ac5-d65c-496e-8c10-d97055ff89b1 service glance] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:33.380422 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e926ac5-d65c-496e-8c10-d97055ff89b1 service glance] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:33.380649 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e926ac5-d65c-496e-8c10-d97055ff89b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:33.444437 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e926ac5-d65c-496e-8c10-d97055ff89b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:33.445923 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e926ac5-d65c-496e-8c10-d97055ff89b1 service glance] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:33.446769 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b342f-d59a-4bf8-b2f8-5590385eca1d None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:33.453089 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f51634-3cf2-4e4e-93c2-8e9a74eb537e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f2083bb2a54a9ca22546b5e7aaf032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:33.453772 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f51634-3cf2-4e4e-93c2-8e9a74eb537e service swift] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:33.454154 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f51634-3cf2-4e4e-93c2-8e9a74eb537e service swift] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:33.454519 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f51634-3cf2-4e4e-93c2-8e9a74eb537e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:33.455483 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 795/1578] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:54:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:54:33.466557 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f51634-3cf2-4e4e-93c2-8e9a74eb537e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:33.468473 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f51634-3cf2-4e4e-93c2-8e9a74eb537e service swift] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:33.481012 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 784/1579] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Sep 25 00:54:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 00:54:35.156082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db563603-a053-42b3-82da-11c9c5e32dca None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:35.157374 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db563603-a053-42b3-82da-11c9c5e32dca None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:35.157790 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db563603-a053-42b3-82da-11c9c5e32dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:35.188451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-db563603-a053-42b3-82da-11c9c5e32dca None None] MFA Rules not processed for user `6c53cca11c1c45a89651026d2ac75cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:35.199735 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-db563603-a053-42b3-82da-11c9c5e32dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:35.278604 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 796/1580] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Sep 25 00:54:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:54:35.315474 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f51634-3cf2-4e4e-93c2-8e9a74eb537e service swift] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:35.335585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f51634-3cf2-4e4e-93c2-8e9a74eb537e service swift] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:35.342960 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b22c0-717f-4e1b-9d2b-e84a314174b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f2083bb2a54a9ca22546b5e7aaf032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:35.343885 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b22c0-717f-4e1b-9d2b-e84a314174b0 service swift] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:35.344313 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b22c0-717f-4e1b-9d2b-e84a314174b0 service swift] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:35.344775 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b22c0-717f-4e1b-9d2b-e84a314174b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:35.352689 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=100 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:54:35.356989 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b22c0-717f-4e1b-9d2b-e84a314174b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:35.359312 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b22c0-717f-4e1b-9d2b-e84a314174b0 service swift] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:35.372259 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 785/1581] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Sep 25 00:54:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 00:54:44.553778 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa670a0-af2d-41d1-90d2-1b000f119755 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:44.554790 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa670a0-af2d-41d1-90d2-1b000f119755 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:44.556095 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa670a0-af2d-41d1-90d2-1b000f119755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:44.577210 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-cfa670a0-af2d-41d1-90d2-1b000f119755 None None] MFA Rules not processed for user `033af76f31cf40829e899b9f7644305f`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:44.578774 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-cfa670a0-af2d-41d1-90d2-1b000f119755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:44.591331 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 797/1582] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:54:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:44.892575 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28030f4-4ab2-4eb4-85f1-785d8600f824 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:44.893200 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28030f4-4ab2-4eb4-85f1-785d8600f824 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:44.893400 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28030f4-4ab2-4eb4-85f1-785d8600f824 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:44.894888 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 786/1583] 10.222.0.27 () {54 vars in 961 bytes} [Sun Sep 25 00:54:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:54:44.900305 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff97e1c-f01f-4adb-81a8-326bdda2b7b0 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:44.900616 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff97e1c-f01f-4adb-81a8-326bdda2b7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:44.900896 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff97e1c-f01f-4adb-81a8-326bdda2b7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:44.941201 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-cff97e1c-f01f-4adb-81a8-326bdda2b7b0 None None] MFA Rules not processed for user `d494b82a81ca42a69fe7d9efc2f2a251`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:44.942433 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-cff97e1c-f01f-4adb-81a8-326bdda2b7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:44.965692 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=100 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:54:45.014587 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 798/1584] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Sep 25 00:54:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:45.020017 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047048c2-df01-4c99-801c-b314f02aba04 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:45.020374 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047048c2-df01-4c99-801c-b314f02aba04 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:45.020774 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047048c2-df01-4c99-801c-b314f02aba04 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:45.022456 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 787/1585] 10.222.0.27 () {54 vars in 912 bytes} [Sun Sep 25 00:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:54:45.027614 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c549-54c9-472e-af8a-561ae95facc6 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:45.027905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c549-54c9-472e-af8a-561ae95facc6 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:45.028188 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c549-54c9-472e-af8a-561ae95facc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:45.053256 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-40a4c549-54c9-472e-af8a-561ae95facc6 None None] MFA Rules not processed for user `d494b82a81ca42a69fe7d9efc2f2a251`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:45.055227 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-40a4c549-54c9-472e-af8a-561ae95facc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:45.065843 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 799/1586] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Sep 25 00:54:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:45.078389 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047048c2-df01-4c99-801c-b314f02aba04 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:45.080284 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-047048c2-df01-4c99-801c-b314f02aba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:45.093640 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047048c2-df01-4c99-801c-b314f02aba04 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:45.097223 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e99e4-5741-4a6f-a88b-f298966dbfcf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2d0afc3294d75897dda3dd8f78aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:45.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e99e4-5741-4a6f-a88b-f298966dbfcf service glance] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:45.099055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e99e4-5741-4a6f-a88b-f298966dbfcf service glance] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:45.099055 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e99e4-5741-4a6f-a88b-f298966dbfcf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:45.112696 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e99e4-5741-4a6f-a88b-f298966dbfcf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:45.115100 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e99e4-5741-4a6f-a88b-f298966dbfcf service glance] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:45.127513 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 788/1587] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:54:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:54:45.616284 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aba71e-7fcf-49ef-8d78-c97cb9d9564a None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:45.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aba71e-7fcf-49ef-8d78-c97cb9d9564a None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:45.616905 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aba71e-7fcf-49ef-8d78-c97cb9d9564a None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:45.618195 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 800/1588] 10.222.0.27 () {54 vars in 912 bytes} [Sun Sep 25 00:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:54:45.624542 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c254ca-5de2-4505-921d-fcdb426ab080 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:45.624915 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c254ca-5de2-4505-921d-fcdb426ab080 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:45.625208 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c254ca-5de2-4505-921d-fcdb426ab080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:45.663289 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-52c254ca-5de2-4505-921d-fcdb426ab080 None None] MFA Rules not processed for user `42a2f85512e648698fdc7ab7cac75752`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:45.664527 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-52c254ca-5de2-4505-921d-fcdb426ab080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:45.719996 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 789/1589] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Sep 25 00:54:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:45.731362 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aba71e-7fcf-49ef-8d78-c97cb9d9564a None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:45.742158 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aba71e-7fcf-49ef-8d78-c97cb9d9564a None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:45.746160 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe097b26-35fd-4b95-b73e-1cf987e32211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:45.746747 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097b26-35fd-4b95-b73e-1cf987e32211 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:45.747023 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097b26-35fd-4b95-b73e-1cf987e32211 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:45.747295 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097b26-35fd-4b95-b73e-1cf987e32211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:45.754324 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe097b26-35fd-4b95-b73e-1cf987e32211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:45.755737 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe097b26-35fd-4b95-b73e-1cf987e32211 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:45.763756 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 801/1590] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:54:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:54:46.148748 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662febc-dc69-4a7a-8eb6-3a8b209925a1 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:46.149278 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662febc-dc69-4a7a-8eb6-3a8b209925a1 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:46.149569 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662febc-dc69-4a7a-8eb6-3a8b209925a1 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:46.151523 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 790/1591] 10.222.0.27 () {54 vars in 961 bytes} [Sun Sep 25 00:54:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:54:46.157642 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61877148-869f-4c85-ba7a-03a07ecc6f59 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:46.157932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61877148-869f-4c85-ba7a-03a07ecc6f59 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:46.158208 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61877148-869f-4c85-ba7a-03a07ecc6f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:46.172882 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662febc-dc69-4a7a-8eb6-3a8b209925a1 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:46.182783 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-61877148-869f-4c85-ba7a-03a07ecc6f59 None None] MFA Rules not processed for user `d494b82a81ca42a69fe7d9efc2f2a251`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:46.184137 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-61877148-869f-4c85-ba7a-03a07ecc6f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:46.193638 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 802/1592] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Sep 25 00:54:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:54:46.199711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa12bc-a861-4dd2-b281-0e5eac723786 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:46.199996 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa12bc-a861-4dd2-b281-0e5eac723786 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:46.200274 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa12bc-a861-4dd2-b281-0e5eac723786 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:46.201595 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 803/1593] 10.222.0.27 () {54 vars in 912 bytes} [Sun Sep 25 00:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:54:46.206082 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd35624-7762-42a1-b96c-4ecbd7d4872f None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:46.206458 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd35624-7762-42a1-b96c-4ecbd7d4872f None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:46.206800 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd35624-7762-42a1-b96c-4ecbd7d4872f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:46.227215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-9bd35624-7762-42a1-b96c-4ecbd7d4872f None None] MFA Rules not processed for user `d494b82a81ca42a69fe7d9efc2f2a251`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:46.228451 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-9bd35624-7762-42a1-b96c-4ecbd7d4872f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:46.237838 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 804/1594] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Sep 25 00:54:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:54:46.249248 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd35624-7762-42a1-b96c-4ecbd7d4872f None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:46.250097 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662febc-dc69-4a7a-8eb6-3a8b209925a1 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:46.250540 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-9bd35624-7762-42a1-b96c-4ecbd7d4872f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:46.255091 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48d030-b7e7-4836-90e9-d6de4c998590 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac1aba93232486eb2bd5b3200cb6fba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:46.255697 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48d030-b7e7-4836-90e9-d6de4c998590 service placement] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:46.255975 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48d030-b7e7-4836-90e9-d6de4c998590 service placement] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:46.256246 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48d030-b7e7-4836-90e9-d6de4c998590 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:46.257971 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-ed48d030-b7e7-4836-90e9-d6de4c998590 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:46.261971 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd35624-7762-42a1-b96c-4ecbd7d4872f None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:46.265547 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edc3b6-9050-4f9d-8b8a-0557725d3450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:46.266152 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edc3b6-9050-4f9d-8b8a-0557725d3450 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:46.266434 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edc3b6-9050-4f9d-8b8a-0557725d3450 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:46.266708 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edc3b6-9050-4f9d-8b8a-0557725d3450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:46.270493 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48d030-b7e7-4836-90e9-d6de4c998590 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:46.272781 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48d030-b7e7-4836-90e9-d6de4c998590 service placement] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:46.279775 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edc3b6-9050-4f9d-8b8a-0557725d3450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:46.281287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edc3b6-9050-4f9d-8b8a-0557725d3450 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:46.283301 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 791/1595] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:54:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 00:54:46.293762 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 805/1596] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:54:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 00:54:48.163688 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464dbf2-31b2-4563-a374-2190844663cd None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:48.164175 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464dbf2-31b2-4563-a374-2190844663cd None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:48.164300 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464dbf2-31b2-4563-a374-2190844663cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:48.184091 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-8464dbf2-31b2-4563-a374-2190844663cd None None] MFA Rules not processed for user `6c53cca11c1c45a89651026d2ac75cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:48.185358 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-8464dbf2-31b2-4563-a374-2190844663cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:48.192529 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 792/1597] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Sep 25 00:54:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:48.205528 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edc3b6-9050-4f9d-8b8a-0557725d3450 service neutron] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:48.217220 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edc3b6-9050-4f9d-8b8a-0557725d3450 service neutron] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:48.222193 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b21964-a9e7-49c1-b3cc-1da93140016e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f2083bb2a54a9ca22546b5e7aaf032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:48.222786 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21964-a9e7-49c1-b3cc-1da93140016e service swift] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:48.223061 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21964-a9e7-49c1-b3cc-1da93140016e service swift] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:48.223329 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21964-a9e7-49c1-b3cc-1da93140016e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:48.231867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b21964-a9e7-49c1-b3cc-1da93140016e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:48.233487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b21964-a9e7-49c1-b3cc-1da93140016e service swift] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:48.242474 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 806/1598] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Sep 25 00:54:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 00:54:55.965368 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca37488-df8a-407e-864e-dfcbb4692cd4 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:55.965873 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca37488-df8a-407e-864e-dfcbb4692cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:55.966085 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca37488-df8a-407e-864e-dfcbb4692cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:55.985901 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-bca37488-df8a-407e-864e-dfcbb4692cd4 None None] MFA Rules not processed for user `42a2f85512e648698fdc7ab7cac75752`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:55.987135 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-bca37488-df8a-407e-864e-dfcbb4692cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:55.993744 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 793/1599] 10.222.0.33 () {58 vars in 1015 bytes} [Sun Sep 25 00:54:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:56.004850 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b21964-a9e7-49c1-b3cc-1da93140016e service swift] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:56.014824 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b21964-a9e7-49c1-b3cc-1da93140016e service swift] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:56.018582 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9657a-8cc6-4ee1-b883-aa7866150e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:56.019198 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9657a-8cc6-4ee1-b883-aa7866150e82 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:56.019497 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9657a-8cc6-4ee1-b883-aa7866150e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:56.019752 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9657a-8cc6-4ee1-b883-aa7866150e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:56.030327 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9657a-8cc6-4ee1-b883-aa7866150e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:56.032003 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9657a-8cc6-4ee1-b883-aa7866150e82 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:56.042188 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 807/1600] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:54:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:54:56.983366 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acd15b-b094-46c7-adf4-ddbe00ae7901 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:56.983891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acd15b-b094-46c7-adf4-ddbe00ae7901 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:56.983891 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acd15b-b094-46c7-adf4-ddbe00ae7901 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:56.985409 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 794/1601] 10.222.0.27 () {54 vars in 921 bytes} [Sun Sep 25 00:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:54:57.019442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723313-fc68-48f9-9aeb-715549715b8d None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:57.019963 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723313-fc68-48f9-9aeb-715549715b8d None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:57.019963 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723313-fc68-48f9-9aeb-715549715b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:57.042360 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-a6723313-fc68-48f9-9aeb-715549715b8d None None] MFA Rules not processed for user `d494b82a81ca42a69fe7d9efc2f2a251`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:54:57.043899 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-a6723313-fc68-48f9-9aeb-715549715b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:54:57.054362 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 808/1602] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Sep 25 00:54:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:54:57.079442 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acd15b-b094-46c7-adf4-ddbe00ae7901 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:54:57.095351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acd15b-b094-46c7-adf4-ddbe00ae7901 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:54:57.101671 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228fd78-b7a1-454f-9a61-3127b5414ffe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:54:57.102495 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228fd78-b7a1-454f-9a61-3127b5414ffe service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:54:57.102789 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228fd78-b7a1-454f-9a61-3127b5414ffe service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:54:57.103068 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228fd78-b7a1-454f-9a61-3127b5414ffe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:54:57.113007 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228fd78-b7a1-454f-9a61-3127b5414ffe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:54:57.114665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228fd78-b7a1-454f-9a61-3127b5414ffe service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:54:57.127261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 795/1603] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:54:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:55:04.073238 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b7b9-a1f8-4948-8024-6fd74e971d40 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:04.073863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b7b9-a1f8-4948-8024-6fd74e971d40 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:04.073863 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b7b9-a1f8-4948-8024-6fd74e971d40 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:04.075169 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 809/1604] 10.222.0.27 () {54 vars in 921 bytes} [Sun Sep 25 00:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:55:04.082717 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7473eb-1f30-4f09-8092-078e66cafd4f None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:04.083433 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7473eb-1f30-4f09-8092-078e66cafd4f None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:04.083525 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7473eb-1f30-4f09-8092-078e66cafd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:04.104307 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-0e7473eb-1f30-4f09-8092-078e66cafd4f None None] MFA Rules not processed for user `d494b82a81ca42a69fe7d9efc2f2a251`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:55:04.105805 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-0e7473eb-1f30-4f09-8092-078e66cafd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:04.115508 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 796/1605] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Sep 25 00:55:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:55:04.132473 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332b7b9-a1f8-4948-8024-6fd74e971d40 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:55:04.149047 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332b7b9-a1f8-4948-8024-6fd74e971d40 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:55:04.155163 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8895a6-f4ff-4b6e-84ec-2aec75c51d83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:55:04.155795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8895a6-f4ff-4b6e-84ec-2aec75c51d83 service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:04.156074 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8895a6-f4ff-4b6e-84ec-2aec75c51d83 service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:04.156340 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8895a6-f4ff-4b6e-84ec-2aec75c51d83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:04.165097 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8895a6-f4ff-4b6e-84ec-2aec75c51d83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:55:04.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8895a6-f4ff-4b6e-84ec-2aec75c51d83 service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:55:04.176671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 810/1606] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:55:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:55:14.099351 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=84 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:14.172567 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=61 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:24.000912 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7473eb-1f30-4f09-8092-078e66cafd4f None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:55:24.010500 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7473eb-1f30-4f09-8092-078e66cafd4f None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:55:24.014385 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88e234-a935-4244-a255-8010769c44e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:55:24.014983 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88e234-a935-4244-a255-8010769c44e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:24.015263 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88e234-a935-4244-a255-8010769c44e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:24.015535 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88e234-a935-4244-a255-8010769c44e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:24.024913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88e234-a935-4244-a255-8010769c44e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:55:24.026344 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88e234-a935-4244-a255-8010769c44e6 service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:55:24.035542 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 797/1607] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:55:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:55:25.971098 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0685fd-6538-42f5-bf12-00d559f64473 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:25.971675 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0685fd-6538-42f5-bf12-00d559f64473 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:25.971675 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0685fd-6538-42f5-bf12-00d559f64473 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:25.972994 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 811/1608] 10.222.0.27 () {54 vars in 921 bytes} [Sun Sep 25 00:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:55:25.978560 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a014eb-b196-4acb-a416-75bc4a93caa1 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:25.980408 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a014eb-b196-4acb-a416-75bc4a93caa1 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:25.980904 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a014eb-b196-4acb-a416-75bc4a93caa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:26.011219 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-18a014eb-b196-4acb-a416-75bc4a93caa1 None None] MFA Rules not processed for user `d494b82a81ca42a69fe7d9efc2f2a251`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:55:26.012949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-18a014eb-b196-4acb-a416-75bc4a93caa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:26.024682 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 798/1609] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Sep 25 00:55:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:55:26.040088 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0685fd-6538-42f5-bf12-00d559f64473 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:55:26.059215 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0685fd-6538-42f5-bf12-00d559f64473 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:55:26.065098 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad44960-f2fa-4e48-b988-88baff13cc94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:55:26.065715 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad44960-f2fa-4e48-b988-88baff13cc94 service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:26.065988 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad44960-f2fa-4e48-b988-88baff13cc94 service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:26.066259 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad44960-f2fa-4e48-b988-88baff13cc94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:26.077929 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad44960-f2fa-4e48-b988-88baff13cc94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:55:26.079846 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad44960-f2fa-4e48-b988-88baff13cc94 service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:55:26.094269 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 812/1610] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:55:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:55:26.829834 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cde67-de89-41ce-a6fe-93e5cb05b3bb None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:26.830122 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cde67-de89-41ce-a6fe-93e5cb05b3bb None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:26.830398 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cde67-de89-41ce-a6fe-93e5cb05b3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:26.859698 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-b04cde67-de89-41ce-a6fe-93e5cb05b3bb None None] MFA Rules not processed for user `1a7192041fb844ad9f9e8ff48606ee67`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:55:26.860869 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-b04cde67-de89-41ce-a6fe-93e5cb05b3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:26.871592 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 799/1611] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:55:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:55:36.087813 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=6 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:36.852478 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=12 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:56:06.940571 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a7ea8-7a90-4a17-96fe-0ffc1a514ab7 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:56:06.941076 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a7ea8-7a90-4a17-96fe-0ffc1a514ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:56:06.941165 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a7ea8-7a90-4a17-96fe-0ffc1a514ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:56:06.960426 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-8b6a7ea8-7a90-4a17-96fe-0ffc1a514ab7 None None] MFA Rules not processed for user `1a7192041fb844ad9f9e8ff48606ee67`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:56:06.961671 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-8b6a7ea8-7a90-4a17-96fe-0ffc1a514ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:56:06.968502 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 813/1612] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:56:16.955493 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=3 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:56:23.835598 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f07c6-fddf-4997-a328-67e8ebc9762c None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:56:23.836058 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f07c6-fddf-4997-a328-67e8ebc9762c None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:56:23.836172 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f07c6-fddf-4997-a328-67e8ebc9762c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:56:23.855582 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-665f07c6-fddf-4997-a328-67e8ebc9762c None None] MFA Rules not processed for user `6c53cca11c1c45a89651026d2ac75cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:56:23.856758 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-665f07c6-fddf-4997-a328-67e8ebc9762c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:56:23.863766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 800/1613] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Sep 25 00:56:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:56:23.905291 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a7ea8-7a90-4a17-96fe-0ffc1a514ab7 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:56:23.916875 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a7ea8-7a90-4a17-96fe-0ffc1a514ab7 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:56:23.921825 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce628798-52dd-4c18-b962-7013808a8ad7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f2083bb2a54a9ca22546b5e7aaf032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:56:23.922422 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce628798-52dd-4c18-b962-7013808a8ad7 service swift] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:56:23.922701 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce628798-52dd-4c18-b962-7013808a8ad7 service swift] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:56:23.922974 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce628798-52dd-4c18-b962-7013808a8ad7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:56:23.930966 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce628798-52dd-4c18-b962-7013808a8ad7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:56:23.932580 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce628798-52dd-4c18-b962-7013808a8ad7 service swift] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:56:23.940367 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 814/1614] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Sep 25 00:56:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 00:56:27.265956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b42d-01ec-438f-af16-fcec912a4742 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:56:27.266361 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b42d-01ec-438f-af16-fcec912a4742 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:56:27.266510 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b42d-01ec-438f-af16-fcec912a4742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:56:27.285061 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-1802b42d-01ec-438f-af16-fcec912a4742 None None] MFA Rules not processed for user `1a7192041fb844ad9f9e8ff48606ee67`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:56:27.286264 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-1802b42d-01ec-438f-af16-fcec912a4742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:56:27.293164 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 801/1615] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:56:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:56:27.591653 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1cde-ff7c-4849-b4c9-87e8c9f440a4 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:56:27.592154 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1cde-ff7c-4849-b4c9-87e8c9f440a4 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:56:27.592252 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1cde-ff7c-4849-b4c9-87e8c9f440a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:56:27.611839 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-447d1cde-ff7c-4849-b4c9-87e8c9f440a4 None None] MFA Rules not processed for user `42a2f85512e648698fdc7ab7cac75752`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:56:27.613074 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-447d1cde-ff7c-4849-b4c9-87e8c9f440a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:56:27.619981 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 815/1616] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Sep 25 00:56:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:56:27.630978 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802b42d-01ec-438f-af16-fcec912a4742 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:56:27.640128 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802b42d-01ec-438f-af16-fcec912a4742 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:56:27.643686 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b1c5c-bbd2-41d8-9050-a9bf806d5c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:56:27.644281 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b1c5c-bbd2-41d8-9050-a9bf806d5c55 service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:56:27.644576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b1c5c-bbd2-41d8-9050-a9bf806d5c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:56:27.644866 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b1c5c-bbd2-41d8-9050-a9bf806d5c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:56:27.651664 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b1c5c-bbd2-41d8-9050-a9bf806d5c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:56:27.653129 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b1c5c-bbd2-41d8-9050-a9bf806d5c55 service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:56:27.660682 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 802/1617] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:56:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:56:37.606958 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=9 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:56:37.657320 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=12 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:56:55.756313 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0c0f5-b851-4e1d-9d31-5914ccd7ee25 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:56:55.756938 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0c0f5-b851-4e1d-9d31-5914ccd7ee25 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:56:55.756938 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0c0f5-b851-4e1d-9d31-5914ccd7ee25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:56:55.777125 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-c9f0c0f5-b851-4e1d-9d31-5914ccd7ee25 None None] MFA Rules not processed for user `6c53cca11c1c45a89651026d2ac75cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:56:55.778503 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-c9f0c0f5-b851-4e1d-9d31-5914ccd7ee25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:56:55.785911 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 816/1618] 10.222.0.27 () {58 vars in 967 bytes} [Sun Sep 25 00:56:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:56:55.799167 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b1c5c-bbd2-41d8-9050-a9bf806d5c55 service neutron] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:56:55.811111 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b1c5c-bbd2-41d8-9050-a9bf806d5c55 service neutron] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:56:55.816003 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d427d4e-cbd0-498b-9b2e-dd0baf6ed2c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f2083bb2a54a9ca22546b5e7aaf032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:56:55.816635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d427d4e-cbd0-498b-9b2e-dd0baf6ed2c8 service swift] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:56:55.816913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d427d4e-cbd0-498b-9b2e-dd0baf6ed2c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:56:55.817183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d427d4e-cbd0-498b-9b2e-dd0baf6ed2c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:56:55.825482 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d427d4e-cbd0-498b-9b2e-dd0baf6ed2c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:56:55.827086 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d427d4e-cbd0-498b-9b2e-dd0baf6ed2c8 service swift] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:56:55.836163 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 803/1619] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Sep 25 00:56:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 00:57:05.770931 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=3 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:57:05.832185 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=6 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:57:12.379043 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888862c2-2cc5-4264-8410-0234ff265d45 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:57:12.380038 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888862c2-2cc5-4264-8410-0234ff265d45 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:57:12.380038 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888862c2-2cc5-4264-8410-0234ff265d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:57:12.398055 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-888862c2-2cc5-4264-8410-0234ff265d45 None None] MFA Rules not processed for user `1a7192041fb844ad9f9e8ff48606ee67`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:57:12.399753 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-888862c2-2cc5-4264-8410-0234ff265d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:57:12.406517 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 817/1620] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:57:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:57:22.392857 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=3 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:57:28.699251 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d427d4e-cbd0-498b-9b2e-dd0baf6ed2c8 service swift] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:57:28.708631 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d427d4e-cbd0-498b-9b2e-dd0baf6ed2c8 service swift] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:57:28.712811 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d3eea-0dec-4e2c-b6ec-ef0fb06b5b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:57:28.713440 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d3eea-0dec-4e2c-b6ec-ef0fb06b5b30 service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:57:28.713714 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d3eea-0dec-4e2c-b6ec-ef0fb06b5b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:57:28.713984 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d3eea-0dec-4e2c-b6ec-ef0fb06b5b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:57:28.726936 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d3eea-0dec-4e2c-b6ec-ef0fb06b5b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:57:28.728353 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d3eea-0dec-4e2c-b6ec-ef0fb06b5b30 service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:57:28.738517 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 804/1621] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:57:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:57:38.733500 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=6 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:58:37.231085 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2678b-9495-41a6-888a-4c30db8db2ff None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:37.231510 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2678b-9495-41a6-888a-4c30db8db2ff None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:37.231643 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2678b-9495-41a6-888a-4c30db8db2ff None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:37.233014 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 818/1622] 10.222.0.27 () {54 vars in 961 bytes} [Sun Sep 25 00:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:58:37.237956 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af003696-b564-4b86-a8aa-f6762bc32301 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:37.238369 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af003696-b564-4b86-a8aa-f6762bc32301 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:37.238497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af003696-b564-4b86-a8aa-f6762bc32301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:37.257704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-af003696-b564-4b86-a8aa-f6762bc32301 None None] MFA Rules not processed for user `bac1aba93232486eb2bd5b3200cb6fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:58:37.258912 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-af003696-b564-4b86-a8aa-f6762bc32301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:58:37.267913 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 805/1623] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Sep 25 00:58:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:58:37.275421 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2678b-9495-41a6-888a-4c30db8db2ff None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:58:37.289301 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2678b-9495-41a6-888a-4c30db8db2ff None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:58:37.294149 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bee3a-72af-47c3-979c-81cca7b808b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac1aba93232486eb2bd5b3200cb6fba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:58:37.294742 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bee3a-72af-47c3-979c-81cca7b808b8 service placement] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:37.295019 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bee3a-72af-47c3-979c-81cca7b808b8 service placement] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:37.295292 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bee3a-72af-47c3-979c-81cca7b808b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:37.303354 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8bee3a-72af-47c3-979c-81cca7b808b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:58:37.304979 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8bee3a-72af-47c3-979c-81cca7b808b8 service placement] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:58:37.314258 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 819/1624] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:58:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:58:38.558016 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3aced4-160e-4353-9e09-301778114d17 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:38.558489 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3aced4-160e-4353-9e09-301778114d17 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:38.558591 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3aced4-160e-4353-9e09-301778114d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:38.577311 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-2f3aced4-160e-4353-9e09-301778114d17 None None] MFA Rules not processed for user `6c53cca11c1c45a89651026d2ac75cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:58:38.578506 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-2f3aced4-160e-4353-9e09-301778114d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:58:38.586504 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 806/1625] 10.222.0.27 () {58 vars in 967 bytes} [Sun Sep 25 00:58:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:58:38.637450 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bee3a-72af-47c3-979c-81cca7b808b8 service placement] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:58:38.649063 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bee3a-72af-47c3-979c-81cca7b808b8 service placement] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:58:38.653957 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0706e-75db-4dd5-b64d-a061088f2c5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f2083bb2a54a9ca22546b5e7aaf032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:58:38.654547 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0706e-75db-4dd5-b64d-a061088f2c5a service swift] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:38.654824 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0706e-75db-4dd5-b64d-a061088f2c5a service swift] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:38.655099 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0706e-75db-4dd5-b64d-a061088f2c5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:38.663443 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0706e-75db-4dd5-b64d-a061088f2c5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:58:38.665055 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0706e-75db-4dd5-b64d-a061088f2c5a service swift] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:58:38.672979 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 820/1626] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Sep 25 00:58:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 00:58:39.144896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6a2d-8136-4f0f-9657-0a0106a18018 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:39.145183 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6a2d-8136-4f0f-9657-0a0106a18018 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:39.145465 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6a2d-8136-4f0f-9657-0a0106a18018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:39.164585 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-537e6a2d-8136-4f0f-9657-0a0106a18018 None None] MFA Rules not processed for user `6c53cca11c1c45a89651026d2ac75cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:58:39.165794 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-537e6a2d-8136-4f0f-9657-0a0106a18018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:58:39.172884 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 807/1627] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Sep 25 00:58:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:58:39.184864 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0706e-75db-4dd5-b64d-a061088f2c5a service swift] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:58:39.195747 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0706e-75db-4dd5-b64d-a061088f2c5a service swift] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:58:39.200765 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cead48-99c5-4991-af8a-8023551509cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f2083bb2a54a9ca22546b5e7aaf032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:58:39.201362 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cead48-99c5-4991-af8a-8023551509cf service swift] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:39.201634 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cead48-99c5-4991-af8a-8023551509cf service swift] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:39.201908 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cead48-99c5-4991-af8a-8023551509cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:39.210644 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cead48-99c5-4991-af8a-8023551509cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:58:39.212233 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cead48-99c5-4991-af8a-8023551509cf service swift] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:58:39.220059 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 821/1628] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Sep 25 00:58:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 00:58:47.524130 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c2d1-4d41-4bb2-9872-1d47362f0393 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:47.524600 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c2d1-4d41-4bb2-9872-1d47362f0393 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:47.524704 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c2d1-4d41-4bb2-9872-1d47362f0393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:47.543813 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-9cb4c2d1-4d41-4bb2-9872-1d47362f0393 None None] MFA Rules not processed for user `033af76f31cf40829e899b9f7644305f`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:58:47.545095 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-9cb4c2d1-4d41-4bb2-9872-1d47362f0393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:58:47.552064 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 808/1629] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:58:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:58:49.216911 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=18 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:58:49.417222 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073869db-169a-435d-91df-cdca6625f0f0 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:49.417536 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073869db-169a-435d-91df-cdca6625f0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:49.417811 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073869db-169a-435d-91df-cdca6625f0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:49.436900 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-073869db-169a-435d-91df-cdca6625f0f0 None None] MFA Rules not processed for user `6c53cca11c1c45a89651026d2ac75cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:58:49.438051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-073869db-169a-435d-91df-cdca6625f0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:58:49.445729 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 822/1630] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Sep 25 00:58:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:58:49.458606 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4c2d1-4d41-4bb2-9872-1d47362f0393 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:58:49.470446 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4c2d1-4d41-4bb2-9872-1d47362f0393 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:58:49.475367 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31fb49-9eec-4ae6-b095-c1b0bb0eb02a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f2083bb2a54a9ca22546b5e7aaf032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:58:49.475975 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31fb49-9eec-4ae6-b095-c1b0bb0eb02a service swift] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:49.476256 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31fb49-9eec-4ae6-b095-c1b0bb0eb02a service swift] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:49.476534 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31fb49-9eec-4ae6-b095-c1b0bb0eb02a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:49.485842 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31fb49-9eec-4ae6-b095-c1b0bb0eb02a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:58:49.487461 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31fb49-9eec-4ae6-b095-c1b0bb0eb02a service swift] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:58:49.495737 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 809/1631] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Sep 25 00:58:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 00:58:59.431844 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=3 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:58:59.492288 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=18 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:59:32.226771 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6eb1b-8aae-47b0-882e-a850ff91a87f None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:59:32.227261 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6eb1b-8aae-47b0-882e-a850ff91a87f None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:59:32.227353 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6eb1b-8aae-47b0-882e-a850ff91a87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:59:32.246327 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-9dd6eb1b-8aae-47b0-882e-a850ff91a87f None None] MFA Rules not processed for user `1a7192041fb844ad9f9e8ff48606ee67`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:59:32.247514 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-9dd6eb1b-8aae-47b0-882e-a850ff91a87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:59:32.254692 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 823/1632] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 00:59:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:59:34.001837 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31fb49-9eec-4ae6-b095-c1b0bb0eb02a service swift] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:59:34.011648 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31fb49-9eec-4ae6-b095-c1b0bb0eb02a service swift] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:59:34.016154 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52b2d9-1336-4002-86a8-e2f97d136bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:59:34.016791 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52b2d9-1336-4002-86a8-e2f97d136bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:59:34.017067 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52b2d9-1336-4002-86a8-e2f97d136bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:59:34.017334 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52b2d9-1336-4002-86a8-e2f97d136bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:59:34.026396 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52b2d9-1336-4002-86a8-e2f97d136bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:59:34.027825 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52b2d9-1336-4002-86a8-e2f97d136bc2 service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:59:34.036665 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 810/1633] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:59:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:59:40.371402 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6eb1b-8aae-47b0-882e-a850ff91a87f None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:59:40.384899 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6eb1b-8aae-47b0-882e-a850ff91a87f None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:59:40.390326 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59d6e1-879c-48f4-a2f9-7efade804a3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:59:40.390927 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59d6e1-879c-48f4-a2f9-7efade804a3e service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:59:40.391209 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59d6e1-879c-48f4-a2f9-7efade804a3e service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:59:40.391487 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59d6e1-879c-48f4-a2f9-7efade804a3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:59:40.399143 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59d6e1-879c-48f4-a2f9-7efade804a3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:59:40.400766 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59d6e1-879c-48f4-a2f9-7efade804a3e service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:59:40.409995 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 824/1634] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:59:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:59:44.032497 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=6 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:59:44.872827 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52b2d9-1336-4002-86a8-e2f97d136bc2 service neutron] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:59:44.884808 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52b2d9-1336-4002-86a8-e2f97d136bc2 service neutron] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:59:44.888367 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a1fbe-aedb-48e8-b6a0-2d4c068286cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:59:44.889033 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a1fbe-aedb-48e8-b6a0-2d4c068286cb service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:59:44.889315 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a1fbe-aedb-48e8-b6a0-2d4c068286cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:59:44.889591 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a1fbe-aedb-48e8-b6a0-2d4c068286cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:59:44.900371 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a1fbe-aedb-48e8-b6a0-2d4c068286cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:59:44.901826 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a1fbe-aedb-48e8-b6a0-2d4c068286cb service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:59:44.912161 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 811/1635] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:59:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:59:45.366867 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59d6e1-879c-48f4-a2f9-7efade804a3e service nova] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:59:45.376520 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59d6e1-879c-48f4-a2f9-7efade804a3e service nova] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:59:45.381479 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7d313-4899-47f8-b79f-3eb907e62eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:59:45.382194 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7d313-4899-47f8-b79f-3eb907e62eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:59:45.382604 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7d313-4899-47f8-b79f-3eb907e62eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:59:45.382982 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7d313-4899-47f8-b79f-3eb907e62eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:59:45.395765 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7d313-4899-47f8-b79f-3eb907e62eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:59:45.397380 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7d313-4899-47f8-b79f-3eb907e62eb1 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:59:45.421103 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 825/1636] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 00:59:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:59:54.907635 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=6 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:59:55.404010 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=15 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:31.808365 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a1fbe-aedb-48e8-b6a0-2d4c068286cb service neutron] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.831628 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a1fbe-aedb-48e8-b6a0-2d4c068286cb service neutron] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.837837 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627800a4-89b3-4349-9f6e-dc9ecc270771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.838631 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627800a4-89b3-4349-9f6e-dc9ecc270771 service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.838949 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627800a4-89b3-4349-9f6e-dc9ecc270771 service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.839319 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627800a4-89b3-4349-9f6e-dc9ecc270771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.849748 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627800a4-89b3-4349-9f6e-dc9ecc270771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.851848 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627800a4-89b3-4349-9f6e-dc9ecc270771 service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.872132 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 812/1637] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:31.974698 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7d313-4899-47f8-b79f-3eb907e62eb1 service neutron] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.985422 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7d313-4899-47f8-b79f-3eb907e62eb1 service neutron] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.989865 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f571cef-5c67-4c5e-a730-6beadc48d5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.990592 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f571cef-5c67-4c5e-a730-6beadc48d5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.990866 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f571cef-5c67-4c5e-a730-6beadc48d5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.991128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f571cef-5c67-4c5e-a730-6beadc48d5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.000375 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f571cef-5c67-4c5e-a730-6beadc48d5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.001954 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f571cef-5c67-4c5e-a730-6beadc48d5f0 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.011061 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 826/1638] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:39.656610 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b1c0-0e47-4fdf-b7a7-02c20a912b54 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.657072 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b1c0-0e47-4fdf-b7a7-02c20a912b54 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.657162 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b1c0-0e47-4fdf-b7a7-02c20a912b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.677545 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-2669b1c0-0e47-4fdf-b7a7-02c20a912b54 None None] MFA Rules not processed for user `6c53cca11c1c45a89651026d2ac75cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:39.678814 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-2669b1c0-0e47-4fdf-b7a7-02c20a912b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:39.686288 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 813/1639] 10.222.0.27 () {58 vars in 967 bytes} [Sun Sep 25 01:00:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:39.728132 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f571cef-5c67-4c5e-a730-6beadc48d5f0 service neutron] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:39.740566 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f571cef-5c67-4c5e-a730-6beadc48d5f0 service neutron] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:39.745497 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57c706-34a3-4a8a-8bb9-108982c7918b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f2083bb2a54a9ca22546b5e7aaf032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:39.746122 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57c706-34a3-4a8a-8bb9-108982c7918b service swift] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.746480 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57c706-34a3-4a8a-8bb9-108982c7918b service swift] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.746757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57c706-34a3-4a8a-8bb9-108982c7918b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.754550 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57c706-34a3-4a8a-8bb9-108982c7918b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:39.756128 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57c706-34a3-4a8a-8bb9-108982c7918b service swift] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:39.763932 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 827/1640] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Sep 25 01:00:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:40.122855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b1c0-0e47-4fdf-b7a7-02c20a912b54 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:40.132173 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b1c0-0e47-4fdf-b7a7-02c20a912b54 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:40.135718 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8003674-a981-409f-bf8b-a554539face1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:40.136313 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8003674-a981-409f-bf8b-a554539face1 service neutron] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:40.136623 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8003674-a981-409f-bf8b-a554539face1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:40.136896 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8003674-a981-409f-bf8b-a554539face1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:40.195130 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8003674-a981-409f-bf8b-a554539face1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:40.196572 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8003674-a981-409f-bf8b-a554539face1 service neutron] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:40.206336 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 814/1641] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:43.610733 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72837a-a4a9-4a52-9d0f-50def25e92d7 None None] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:43.611754 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72837a-a4a9-4a52-9d0f-50def25e92d7 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:43.611844 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72837a-a4a9-4a52-9d0f-50def25e92d7 None None] PATH_INFO: `/` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:43.613221 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 828/1642] 10.222.0.27 () {54 vars in 921 bytes} [Sun Sep 25 01:00:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:43.639732 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95070cce-9516-48b0-b4e4-11b762505d79 None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:43.640240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95070cce-9516-48b0-b4e4-11b762505d79 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:43.640332 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95070cce-9516-48b0-b4e4-11b762505d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:43.661048 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-95070cce-9516-48b0-b4e4-11b762505d79 None None] MFA Rules not processed for user `bac1aba93232486eb2bd5b3200cb6fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:43.662294 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-95070cce-9516-48b0-b4e4-11b762505d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:43.671897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 815/1643] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Sep 25 01:00:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:43.693490 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72837a-a4a9-4a52-9d0f-50def25e92d7 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:43.706983 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72837a-a4a9-4a52-9d0f-50def25e92d7 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:43.712433 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53641a-19a8-4dfe-8c1c-c122831275f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac1aba93232486eb2bd5b3200cb6fba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:43.713539 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53641a-19a8-4dfe-8c1c-c122831275f5 service placement] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:43.713824 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53641a-19a8-4dfe-8c1c-c122831275f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:43.714098 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53641a-19a8-4dfe-8c1c-c122831275f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:43.723295 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53641a-19a8-4dfe-8c1c-c122831275f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:43.725110 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53641a-19a8-4dfe-8c1c-c122831275f5 service placement] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:43.734801 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 829/1644] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:46.751206 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95070cce-9516-48b0-b4e4-11b762505d79 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:46.766835 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95070cce-9516-48b0-b4e4-11b762505d79 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:46.771543 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:46.772186 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:46.772465 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:46.772769 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] PATH_INFO: `/v3/users/033af76f31cf40829e899b9f7644305f` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:46.773919 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=033af76f31cf40829e899b9f7644305f)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:46.774936 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: WARNING py.warnings [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:00:46.774936 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: warnings.warn(msg) Sep 25 01:00:46.774936 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: Sep 25 01:00:46.776150 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:46.845799 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '033af76f31cf40829e899b9f7644305f'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:46.865423 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '033af76f31cf40829e899b9f7644305f'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:46.876096 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '033af76f31cf40829e899b9f7644305f'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:46.884525 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '033af76f31cf40829e899b9f7644305f'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:46.885258 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '033af76f31cf40829e899b9f7644305f'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:46.892302 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 816/1645] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:46 2022] DELETE /identity/v3/users/033af76f31cf40829e899b9f7644305f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:47.072209 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53641a-19a8-4dfe-8c1c-c122831275f5 service placement] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:47.084118 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53641a-19a8-4dfe-8c1c-c122831275f5 service placement] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:47.143348 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:47.143983 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:47.144260 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:47.144532 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] PATH_INFO: `/v3/projects/594de123c0c84fe7a903e5dcdf90c29b` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:47.145677 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594de123c0c84fe7a903e5dcdf90c29b)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:47.146702 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: WARNING py.warnings [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:00:47.146702 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: warnings.warn(msg) Sep 25 01:00:47.146702 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: Sep 25 01:00:47.147895 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:47.205807 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594de123c0c84fe7a903e5dcdf90c29b', 'request_id': 'req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.213170 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594de123c0c84fe7a903e5dcdf90c29b', 'request_id': 'req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.219279 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594de123c0c84fe7a903e5dcdf90c29b', 'request_id': 'req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.237951 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] The token cache is being invalidate because project 594de123c0c84fe7a903e5dcdf90c29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:47.238237 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.238865 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.240336 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 830/1646] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:47 2022] DELETE /identity/v3/projects/594de123c0c84fe7a903e5dcdf90c29b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:47.244292 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:47.245745 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:47.258576 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad510dd9-01f6-4fa1-9d10-ac1a64a981fd admin admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:47.296619 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:47.316714 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf56b8-b425-45c0-9380-d22a99a2cd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:47.317345 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf56b8-b425-45c0-9380-d22a99a2cd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:47.317623 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf56b8-b425-45c0-9380-d22a99a2cd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:47.317895 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf56b8-b425-45c0-9380-d22a99a2cd4f admin admin] PATH_INFO: `/v3/users/e7f2f98d23f14db3ba173a3d42924f11` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:47.319002 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf56b8-b425-45c0-9380-d22a99a2cd4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7f2f98d23f14db3ba173a3d42924f11)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:47.320952 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf56b8-b425-45c0-9380-d22a99a2cd4f admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:47.371179 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-51cf56b8-b425-45c0-9380-d22a99a2cd4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7f2f98d23f14db3ba173a3d42924f11'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.385837 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-51cf56b8-b425-45c0-9380-d22a99a2cd4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7f2f98d23f14db3ba173a3d42924f11'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.393347 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-51cf56b8-b425-45c0-9380-d22a99a2cd4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7f2f98d23f14db3ba173a3d42924f11'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.401790 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-51cf56b8-b425-45c0-9380-d22a99a2cd4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7f2f98d23f14db3ba173a3d42924f11'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.402415 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-51cf56b8-b425-45c0-9380-d22a99a2cd4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7f2f98d23f14db3ba173a3d42924f11'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.409446 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 817/1647] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:47 2022] DELETE /identity/v3/users/e7f2f98d23f14db3ba173a3d42924f11 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:47.580745 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:47.582231 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:47.596286 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736569c6-ec3b-49d3-8e0e-9aa7cf974e64 admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:47.646335 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:47.659324 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:47.659964 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:47.660244 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:47.660522 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] PATH_INFO: `/v3/projects/37c98b187f0142c9bd8c4d151a93e36a` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:47.661788 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c98b187f0142c9bd8c4d151a93e36a)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:47.664103 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:47.712100 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c98b187f0142c9bd8c4d151a93e36a', 'request_id': 'req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.719410 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c98b187f0142c9bd8c4d151a93e36a', 'request_id': 'req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.725573 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c98b187f0142c9bd8c4d151a93e36a', 'request_id': 'req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.736195 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] The token cache is being invalidate because project 37c98b187f0142c9bd8c4d151a93e36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:47.736463 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.737117 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.738581 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 831/1648] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:47 2022] DELETE /identity/v3/projects/37c98b187f0142c9bd8c4d151a93e36a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:57.404935 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:57.733354 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:24.436240 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaef4b-69fb-4087-b411-6a1d63b6c8ac None None] REQUEST_METHOD: `POST` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:24.436801 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaef4b-69fb-4087-b411-6a1d63b6c8ac None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:24.436801 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaef4b-69fb-4087-b411-6a1d63b6c8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:24.455873 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.auth.core [None req-28eaef4b-69fb-4087-b411-6a1d63b6c8ac None None] MFA Rules not processed for user `1a7192041fb844ad9f9e8ff48606ee67`. Rule list: `[]` (Enabled: `True`). {{(pid=81371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:24.457109 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-28eaef4b-69fb-4087-b411-6a1d63b6c8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:24.512335 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 818/1649] 10.222.0.27 () {58 vars in 958 bytes} [Sun Sep 25 01:01:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:24.833929 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:24.835825 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:24.891219 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5bf65-2b86-4e3a-8d9b-eeee23a12689 admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:24.895346 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3873c-61f5-4d7c-bd0f-e4c574611ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:24.895952 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3873c-61f5-4d7c-bd0f-e4c574611ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:24.896229 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3873c-61f5-4d7c-bd0f-e4c574611ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:24.896497 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3873c-61f5-4d7c-bd0f-e4c574611ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:24.898230 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-c1f3873c-61f5-4d7c-bd0f-e4c574611ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:24.907225 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3873c-61f5-4d7c-bd0f-e4c574611ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:24.908666 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3873c-61f5-4d7c-bd0f-e4c574611ce4 service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:24.916842 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 832/1650] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:26.361972 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eaef4b-69fb-4087-b411-6a1d63b6c8ac None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:26.364102 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-28eaef4b-69fb-4087-b411-6a1d63b6c8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:26.434034 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eaef4b-69fb-4087-b411-6a1d63b6c8ac None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:26.438969 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88c281-70f8-470d-b09d-1c4a8ad2e33c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac1aba93232486eb2bd5b3200cb6fba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:26.439574 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88c281-70f8-470d-b09d-1c4a8ad2e33c service placement] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:26.439849 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88c281-70f8-470d-b09d-1c4a8ad2e33c service placement] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:26.440119 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88c281-70f8-470d-b09d-1c4a8ad2e33c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:26.441881 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-2f88c281-70f8-470d-b09d-1c4a8ad2e33c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:26.452650 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88c281-70f8-470d-b09d-1c4a8ad2e33c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:26.454219 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88c281-70f8-470d-b09d-1c4a8ad2e33c service placement] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:26.464320 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 819/1651] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:34.913578 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=26 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:36.460375 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=57 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:39.836795 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3873c-61f5-4d7c-bd0f-e4c574611ce4 service neutron] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:39.838178 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-c1f3873c-61f5-4d7c-bd0f-e4c574611ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:39.919816 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3873c-61f5-4d7c-bd0f-e4c574611ce4 service neutron] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:39.925240 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48815721-111b-49e6-9482-cbfe7a62ec51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:39.925849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48815721-111b-49e6-9482-cbfe7a62ec51 service nova] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:39.926135 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48815721-111b-49e6-9482-cbfe7a62ec51 service nova] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:39.926412 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48815721-111b-49e6-9482-cbfe7a62ec51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:39.928280 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-48815721-111b-49e6-9482-cbfe7a62ec51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:39.940418 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48815721-111b-49e6-9482-cbfe7a62ec51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:39.941995 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48815721-111b-49e6-9482-cbfe7a62ec51 service nova] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:39.952232 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 833/1652] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:49.947981 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=34 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:20.540758 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88c281-70f8-470d-b09d-1c4a8ad2e33c service placement] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:20.611485 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88c281-70f8-470d-b09d-1c4a8ad2e33c service placement] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:20.617330 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43c42a-088c-4ddd-91ba-01e1dd621c77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494b82a81ca42a69fe7d9efc2f2a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:20.617859 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43c42a-088c-4ddd-91ba-01e1dd621c77 service nova] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:20.618134 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43c42a-088c-4ddd-91ba-01e1dd621c77 service nova] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:20.618404 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43c42a-088c-4ddd-91ba-01e1dd621c77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:20.620138 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-2e43c42a-088c-4ddd-91ba-01e1dd621c77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:20.653821 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43c42a-088c-4ddd-91ba-01e1dd621c77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:20.655402 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43c42a-088c-4ddd-91ba-01e1dd621c77 service nova] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:20.666109 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 820/1653] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:03:23.780885 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48815721-111b-49e6-9482-cbfe7a62ec51 service nova] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:23.830834 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48815721-111b-49e6-9482-cbfe7a62ec51 service nova] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:23.834757 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa0551-b8a0-45fe-ac63-68b1eae38c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a2f85512e648698fdc7ab7cac75752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:23.835394 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0551-b8a0-45fe-ac63-68b1eae38c4a service neutron] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:23.835672 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0551-b8a0-45fe-ac63-68b1eae38c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:23.835945 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0551-b8a0-45fe-ac63-68b1eae38c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:23.837954 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-5faa0551-b8a0-45fe-ac63-68b1eae38c4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:23.920376 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa0551-b8a0-45fe-ac63-68b1eae38c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:23.921837 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa0551-b8a0-45fe-ac63-68b1eae38c4a service neutron] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:23.940442 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 834/1654] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:26.902855 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3454d4d-7ca9-49b0-b8fe-38be0068c854 None None] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:26.903395 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3454d4d-7ca9-49b0-b8fe-38be0068c854 None None] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:26.903395 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3454d4d-7ca9-49b0-b8fe-38be0068c854 None None] PATH_INFO: `/` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:26.904810 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 821/1655] 10.222.0.27 () {54 vars in 921 bytes} [Sun Sep 25 01:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:03:26.932667 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9502b-414d-4903-a9f4-843194d26ff9 None None] REQUEST_METHOD: `POST` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:26.933177 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9502b-414d-4903-a9f4-843194d26ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:26.933287 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9502b-414d-4903-a9f4-843194d26ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:27.009177 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.auth.core [None req-e3e9502b-414d-4903-a9f4-843194d26ff9 None None] MFA Rules not processed for user `bac1aba93232486eb2bd5b3200cb6fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:27.010395 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-e3e9502b-414d-4903-a9f4-843194d26ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:27.029575 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 835/1656] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Sep 25 01:03:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:27.040657 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3454d4d-7ca9-49b0-b8fe-38be0068c854 None None] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:27.054928 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3454d4d-7ca9-49b0-b8fe-38be0068c854 None None] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:27.059909 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a71c3f-8074-45da-8d5e-586ce1655eb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac1aba93232486eb2bd5b3200cb6fba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:27.060540 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a71c3f-8074-45da-8d5e-586ce1655eb7 service placement] REQUEST_METHOD: `GET` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:27.060850 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a71c3f-8074-45da-8d5e-586ce1655eb7 service placement] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:27.061124 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a71c3f-8074-45da-8d5e-586ce1655eb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:27.070038 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a71c3f-8074-45da-8d5e-586ce1655eb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:27.071614 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a71c3f-8074-45da-8d5e-586ce1655eb7 service placement] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:27.081223 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 822/1657] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:30.150543 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9502b-414d-4903-a9f4-843194d26ff9 None None] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:30.151955 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-e3e9502b-414d-4903-a9f4-843194d26ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:30.169787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9502b-414d-4903-a9f4-843194d26ff9 None None] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:30.174911 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51758d-b40f-4d2b-b1b0-d30b01077e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:30.175545 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51758d-b40f-4d2b-b1b0-d30b01077e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:30.175822 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51758d-b40f-4d2b-b1b0-d30b01077e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:30.176097 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51758d-b40f-4d2b-b1b0-d30b01077e9a admin admin] PATH_INFO: `/v3/users/1a7192041fb844ad9f9e8ff48606ee67` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:30.177326 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51758d-b40f-4d2b-b1b0-d30b01077e9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a7192041fb844ad9f9e8ff48606ee67)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:30.179297 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51758d-b40f-4d2b-b1b0-d30b01077e9a admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:30.217612 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:30.227682 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-df51758d-b40f-4d2b-b1b0-d30b01077e9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a7192041fb844ad9f9e8ff48606ee67'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.239501 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-df51758d-b40f-4d2b-b1b0-d30b01077e9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a7192041fb844ad9f9e8ff48606ee67'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.246322 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-df51758d-b40f-4d2b-b1b0-d30b01077e9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a7192041fb844ad9f9e8ff48606ee67'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.252787 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-df51758d-b40f-4d2b-b1b0-d30b01077e9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a7192041fb844ad9f9e8ff48606ee67'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.253417 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-df51758d-b40f-4d2b-b1b0-d30b01077e9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a7192041fb844ad9f9e8ff48606ee67'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.259235 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 836/1658] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Sep 25 01:03:30 2022] DELETE /identity/v3/users/1a7192041fb844ad9f9e8ff48606ee67 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:30.443764 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a71c3f-8074-45da-8d5e-586ce1655eb7 service placement] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:30.455149 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a71c3f-8074-45da-8d5e-586ce1655eb7 service placement] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:30.511502 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:30.512065 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:30.512342 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:30.512653 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] PATH_INFO: `/v3/projects/f3b9f79711ca45f8ae6d9835faa10c7f` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:30.513760 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b9f79711ca45f8ae6d9835faa10c7f)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:30.515671 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:30.559998 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b9f79711ca45f8ae6d9835faa10c7f', 'request_id': 'req-45e34a77-a711-46da-b577-6ecba23f8d45'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.566676 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b9f79711ca45f8ae6d9835faa10c7f', 'request_id': 'req-45e34a77-a711-46da-b577-6ecba23f8d45'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.572319 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b9f79711ca45f8ae6d9835faa10c7f', 'request_id': 'req-45e34a77-a711-46da-b577-6ecba23f8d45'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.573908 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:30.589307 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] The token cache is being invalidate because project f3b9f79711ca45f8ae6d9835faa10c7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:03:30.589670 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.590261 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.591865 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 823/1659] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:30 2022] DELETE /identity/v3/projects/f3b9f79711ca45f8ae6d9835faa10c7f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:30.596217 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51758d-b40f-4d2b-b1b0-d30b01077e9a admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:30.597740 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-df51758d-b40f-4d2b-b1b0-d30b01077e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:30.616449 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51758d-b40f-4d2b-b1b0-d30b01077e9a admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:30.674799 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f04cd1-e65b-4e5a-8789-883d77556fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:30.675431 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04cd1-e65b-4e5a-8789-883d77556fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:30.675711 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04cd1-e65b-4e5a-8789-883d77556fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:30.675987 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04cd1-e65b-4e5a-8789-883d77556fc4 admin admin] PATH_INFO: `/v3/users/4fc10d942976480b94486fc34b8aa3d6` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:30.677129 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f04cd1-e65b-4e5a-8789-883d77556fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc10d942976480b94486fc34b8aa3d6)` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:30.679051 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f04cd1-e65b-4e5a-8789-883d77556fc4 admin admin] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:30.724724 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-91f04cd1-e65b-4e5a-8789-883d77556fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc10d942976480b94486fc34b8aa3d6'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.741099 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-91f04cd1-e65b-4e5a-8789-883d77556fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc10d942976480b94486fc34b8aa3d6'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.748035 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-91f04cd1-e65b-4e5a-8789-883d77556fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc10d942976480b94486fc34b8aa3d6'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.756044 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-91f04cd1-e65b-4e5a-8789-883d77556fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc10d942976480b94486fc34b8aa3d6'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.756686 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.notifications [None req-91f04cd1-e65b-4e5a-8789-883d77556fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc10d942976480b94486fc34b8aa3d6'} {{(pid=81370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:30.762849 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 837/1660] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Sep 25 01:03:30 2022] DELETE /identity/v3/users/4fc10d942976480b94486fc34b8aa3d6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:30.932987 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] Authenticating user token {{(pid=81371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:30.934487 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.fernet_utils [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:30.949508 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e34a77-a711-46da-b577-6ecba23f8d45 admin admin] Validating token access rules against request {{(pid=81371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:31.006566 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04372b7e-ccef-47cf-9063-2f7de3fce221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c04946a10143a58b50e26046837bb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20cd80763f84ad5bcde9f24ede790c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:31.007212 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04372b7e-ccef-47cf-9063-2f7de3fce221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:31.007506 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04372b7e-ccef-47cf-9063-2f7de3fce221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:31.007781 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04372b7e-ccef-47cf-9063-2f7de3fce221 admin admin] PATH_INFO: `/v3/projects/f7df8be82fb8449f97f85cc234eb97ab` {{(pid=81371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:31.008942 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04372b7e-ccef-47cf-9063-2f7de3fce221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7df8be82fb8449f97f85cc234eb97ab)` {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:31.010861 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04372b7e-ccef-47cf-9063-2f7de3fce221 admin admin] RBAC: Authorization granted {{(pid=81371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:31.055025 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-04372b7e-ccef-47cf-9063-2f7de3fce221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7df8be82fb8449f97f85cc234eb97ab', 'request_id': 'req-04372b7e-ccef-47cf-9063-2f7de3fce221'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:31.060886 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-04372b7e-ccef-47cf-9063-2f7de3fce221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7df8be82fb8449f97f85cc234eb97ab', 'request_id': 'req-04372b7e-ccef-47cf-9063-2f7de3fce221'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:31.066897 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-04372b7e-ccef-47cf-9063-2f7de3fce221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7df8be82fb8449f97f85cc234eb97ab', 'request_id': 'req-04372b7e-ccef-47cf-9063-2f7de3fce221'} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:31.078626 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-04372b7e-ccef-47cf-9063-2f7de3fce221 admin admin] The token cache is being invalidate because project f7df8be82fb8449f97f85cc234eb97ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:03:31.078907 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-04372b7e-ccef-47cf-9063-2f7de3fce221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:31.079552 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG keystone.notifications [None req-04372b7e-ccef-47cf-9063-2f7de3fce221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:31.081035 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: [pid: 81371|app: 0|req: 824/1661] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:30 2022] DELETE /identity/v3/projects/f7df8be82fb8449f97f85cc234eb97ab => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:40.759334 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=68,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:41.075766 dv-osbrick-master-4-iscsi devstack@keystone.service[81371]: DEBUG dbcounter [-] [81371] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=53 {{(pid=81371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:47.865538 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f04cd1-e65b-4e5a-8789-883d77556fc4 admin admin] Authenticating user token {{(pid=81370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:47.866935 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-91f04cd1-e65b-4e5a-8789-883d77556fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:47.936865 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f04cd1-e65b-4e5a-8789-883d77556fc4 admin admin] Validating token access rules against request {{(pid=81370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:47.996604 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf6d18-3259-43b2-a558-92ad1233e6be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac1aba93232486eb2bd5b3200cb6fba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5f67cc330446d1b77c741139f68e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:47.997140 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf6d18-3259-43b2-a558-92ad1233e6be service placement] REQUEST_METHOD: `GET` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:47.997421 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf6d18-3259-43b2-a558-92ad1233e6be service placement] SCRIPT_NAME: `/identity` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:47.997699 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf6d18-3259-43b2-a558-92ad1233e6be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:47.999438 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.fernet_utils [None req-b2bf6d18-3259-43b2-a558-92ad1233e6be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:48.011744 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf6d18-3259-43b2-a558-92ad1233e6be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:48.013384 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf6d18-3259-43b2-a558-92ad1233e6be service placement] RBAC: Authorization granted {{(pid=81370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:48.023529 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: [pid: 81370|app: 0|req: 838/1662] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:58.019556 dv-osbrick-master-4-iscsi devstack@keystone.service[81370]: DEBUG dbcounter [-] [81370] Writing DB stats keystone:SELECT=58 {{(pid=81370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}